[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:19:29 dist-test-slave-r9ct krb5kdc[3949](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:19:29 dist-test-slave-r9ct krb5kdc[3949](info): set up 2 sockets
Jun 18 23:19:29 dist-test-slave-r9ct krb5kdc[3949](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260618 23:19:30.368222 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:19:30 dist-test-slave-r9ct krb5kdc[3949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:19:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:19:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:19:30.497731 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:34063
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:37873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:34063
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:30.577602 3962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:30.577876 3962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:30.577915 3962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:30.579124 3962 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:19:30.579195 3962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:30.579218 3962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:30.579241 3962 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:19:30.579268 3962 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:19:30.580708 3962 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:37873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:34063
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:34063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3962
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:30.580977 3962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:30.581264 3962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260618 23:19:30.586892 3962 server_base.cc:1034] running on GCE node
W20260618 23:19:30.587011 3970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:30.587033 3968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:30.587033 3967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:30.587430 3962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:30.587925 3962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:30.589159 3962 hybrid_clock.cc:648] HybridClock initialized: now 1781824770589121 us; error 53 us; skew 500 ppm
Jun 18 23:19:30 dist-test-slave-r9ct krb5kdc[3949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824770, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:30.591830 3962 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:19:30.592306 3962 webserver.cc:460] Webserver started at http://127.3.217.190:44195/ using document root <none> and password file <none>
I20260618 23:19:30.592530 3962 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:30.592576 3962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:30.592702 3962 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:30.593753 3962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "c22136bd55a248a9a2f991c8b447bc8a"
format_stamp: "Formatted at 2026-06-18 23:19:30 on dist-test-slave-r9ct"
server_key: "f14e5c8890e91154930b84b2d7312704"
server_key_iv: "6335f8fc2e11c3c111672d0fb58365af"
server_key_version: "encryptionkey@0"
I20260618 23:19:30.594125 3962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "c22136bd55a248a9a2f991c8b447bc8a"
format_stamp: "Formatted at 2026-06-18 23:19:30 on dist-test-slave-r9ct"
server_key: "f14e5c8890e91154930b84b2d7312704"
server_key_iv: "6335f8fc2e11c3c111672d0fb58365af"
server_key_version: "encryptionkey@0"
I20260618 23:19:30.595623 3962 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:19:30.596531 3977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:30.596940 3962 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:30.597031 3962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "c22136bd55a248a9a2f991c8b447bc8a"
format_stamp: "Formatted at 2026-06-18 23:19:30 on dist-test-slave-r9ct"
server_key: "f14e5c8890e91154930b84b2d7312704"
server_key_iv: "6335f8fc2e11c3c111672d0fb58365af"
server_key_version: "encryptionkey@0"
I20260618 23:19:30.597121 3962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:30.613688 3962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:30.616153 3962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:30.616297 3962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:30.620496 3962 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:34063
I20260618 23:19:30.620524 4029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:34063 every 8 connection(s)
I20260618 23:19:30.620894 3962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:19:30.621737 4030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:30.622730 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 3962
I20260618 23:19:30.622848 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:19:30.623603 3942 external_mini_cluster.cc:1428] Setting key db6476a2bac33b7eb921ae98fd1b0d2e
I20260618 23:19:30.624795 4030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a: Bootstrap starting.
I20260618 23:19:30.625512 4030 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:30.625854 4030 log.cc:824] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:30.626662 4030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a: No bootstrap required, opened a new log
I20260618 23:19:30.628484 4030 raft_consensus.cc:348] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c22136bd55a248a9a2f991c8b447bc8a" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34063 } }
I20260618 23:19:30.628618 4030 raft_consensus.cc:374] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:30.628643 4030 raft_consensus.cc:729] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c22136bd55a248a9a2f991c8b447bc8a, State: Initialized, Role: FOLLOWER
I20260618 23:19:30.628808 4030 consensus_queue.cc:260] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c22136bd55a248a9a2f991c8b447bc8a" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34063 } }
I20260618 23:19:30.628911 4030 raft_consensus.cc:388] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:19:30.628950 4030 raft_consensus.cc:482] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:19:30.629037 4030 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:30.630256 4030 raft_consensus.cc:504] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c22136bd55a248a9a2f991c8b447bc8a" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34063 } }
I20260618 23:19:30.630355 4030 leader_election.cc:302] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c22136bd55a248a9a2f991c8b447bc8a; no voters:
I20260618 23:19:30.630522 4030 leader_election.cc:288] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:19:30.630628 4035 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:30.630839 4030 sys_catalog.cc:564] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:19:30.630849 4035 raft_consensus.cc:686] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a [term 1 LEADER]: Becoming Leader. State: Replica: c22136bd55a248a9a2f991c8b447bc8a, State: Running, Role: LEADER
I20260618 23:19:30.631138 4035 consensus_queue.cc:237] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c22136bd55a248a9a2f991c8b447bc8a" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34063 } }
I20260618 23:19:30.631518 4037 sys_catalog.cc:455] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c22136bd55a248a9a2f991c8b447bc8a. Latest consensus state: current_term: 1 leader_uuid: "c22136bd55a248a9a2f991c8b447bc8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c22136bd55a248a9a2f991c8b447bc8a" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34063 } } }
I20260618 23:19:30.631609 4037 sys_catalog.cc:458] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:30.631904 4036 sys_catalog.cc:455] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c22136bd55a248a9a2f991c8b447bc8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c22136bd55a248a9a2f991c8b447bc8a" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34063 } } }
I20260618 23:19:30.631949 4036 sys_catalog.cc:458] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:30.632220 4044 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:19:30.632877 4044 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:19:30.635205 4044 catalog_manager.cc:1347] Generated new cluster ID: 71a12d8282da40cd902b753be43f55af
I20260618 23:19:30.635272 4044 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 18 23:19:30 dist-test-slave-r9ct krb5kdc[3949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:30.644268 4033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:30.624505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58424 (local address 127.3.217.190:34063)
0618 23:19:30.624809 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:30.624817 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:30.625034 (+ 217us) server_negotiation.cc:407] Connection header received
0618 23:19:30.628501 (+ 3467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:30.628508 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:30.628555 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:30.628725 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:30.630575 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:30.632147 (+ 1572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:30.633384 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:30.633955 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:30.634070 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:30.639095 (+ 5025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:30.639108 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:30.639108 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:30.639129 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:30.641733 (+ 2604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:30.642348 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:30.642352 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:30.642353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:30.642516 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:30.642864 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:30.642865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:30.642865 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:30.643208 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:30.643372 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:30.643784 (+ 412us) server_negotiation.cc:299] Negotiation successful
0618 23:19:30.643961 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":86,"threads_started":1}
I20260618 23:19:30.646224 4044 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:19:30.646965 4044 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:19:30.656131 4044 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c22136bd55a248a9a2f991c8b447bc8a: Generated new TSK 0
I20260618 23:19:30.656329 4044 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.217.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
I20260618 23:19:30.687968 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34063
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:37873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:30.786267 4056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:30.786475 4056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:30.786501 4056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:30.788036 4056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:30.788089 4056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:30.788120 4056 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:19:30.789989 4056 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:37873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34063
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:30.790581 4056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:30.790894 4056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:30.796576 4064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:30.796586 4062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:30.796587 4061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:30.796766 4056 server_base.cc:1034] running on GCE node
I20260618 23:19:30.797118 4056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:30.797397 4056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:30.798589 4056 hybrid_clock.cc:648] HybridClock initialized: now 1781824770798563 us; error 43 us; skew 500 ppm
Jun 18 23:19:30 dist-test-slave-r9ct krb5kdc[3949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824770, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:30.801662 4056 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:19:30.802138 4056 webserver.cc:460] Webserver started at http://127.3.217.129:40191/ using document root <none> and password file <none>
I20260618 23:19:30.802390 4056 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:30.802462 4056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:30.802613 4056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:30.803742 4056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "3699440e1cfa463ea05a9acdd8059089"
format_stamp: "Formatted at 2026-06-18 23:19:30 on dist-test-slave-r9ct"
server_key: "0cac5298232e5683d9b74f756cf67576"
server_key_iv: "9a8a66a6b51b7c963d925489fca2179c"
server_key_version: "encryptionkey@0"
I20260618 23:19:30.804129 4056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "3699440e1cfa463ea05a9acdd8059089"
format_stamp: "Formatted at 2026-06-18 23:19:30 on dist-test-slave-r9ct"
server_key: "0cac5298232e5683d9b74f756cf67576"
server_key_iv: "9a8a66a6b51b7c963d925489fca2179c"
server_key_version: "encryptionkey@0"
I20260618 23:19:30.805814 4056 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260618 23:19:30.807067 4071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:30.807493 4056 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:30.807626 4056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "3699440e1cfa463ea05a9acdd8059089"
format_stamp: "Formatted at 2026-06-18 23:19:30 on dist-test-slave-r9ct"
server_key: "0cac5298232e5683d9b74f756cf67576"
server_key_iv: "9a8a66a6b51b7c963d925489fca2179c"
server_key_version: "encryptionkey@0"
I20260618 23:19:30.808204 4056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:30.836377 4056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:30.839392 4056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:30.839563 4056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:30.839839 4056 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:30.840158 4056 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:30.840216 4056 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:30.840261 4056 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:30.840291 4056 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:30.848151 4056 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:39775
I20260618 23:19:30.848209 4184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:39775 every 8 connection(s)
I20260618 23:19:30.848577 4056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:19:30.855201 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 4056
I20260618 23:19:30.855327 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:19:30.855496 3942 external_mini_cluster.cc:1428] Setting key 268678b209047ca9f39d655f46dc5f5c
Jun 18 23:19:30 dist-test-slave-r9ct krb5kdc[3949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824770, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:30.860306 4033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:30.849390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:37709 (local address 127.3.217.190:34063)
0618 23:19:30.849436 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:30.849439 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:30.849664 (+ 225us) server_negotiation.cc:407] Connection header received
0618 23:19:30.850335 (+ 671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:30.850337 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:30.850352 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:30.850412 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:30.851674 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:30.852190 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:30.853188 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:30.853417 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:30.853490 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:30.856880 (+ 3390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:30.856881 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:30.856882 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:30.856890 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:30.858338 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:30.858813 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:30.858814 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:30.858814 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:30.858875 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:30.859269 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:30.859270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:30.859270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:30.859390 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:30.859453 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:30.860078 (+ 625us) server_negotiation.cc:299] Negotiation successful
0618 23:19:30.860215 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260618 23:19:30.860680 4187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:30.849361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:34063 (local address 127.3.217.129:37709)
0618 23:19:30.849542 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:30.849579 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:30.850212 (+ 633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:30.850479 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:30.850483 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:30.851255 (+ 772us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:30.851543 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:30.851549 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:30.852294 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:30.852295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:30.853082 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:30.853084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:30.853508 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:30.853510 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:30.853633 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:30.854435 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:30.854448 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:30.856742 (+ 2294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:30.858441 (+ 1699us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:30.858452 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:30.858454 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:30.858684 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:30.858946 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:30.858947 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:30.858948 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:30.859094 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:30.859467 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:30.859473 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:30.859647 (+ 174us) client_negotiation.cc:769] Sending connection context
0618 23:19:30.859769 (+ 122us) client_negotiation.cc:240] Negotiation successful
0618 23:19:30.860338 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":90,"threads_started":1}
I20260618 23:19:30.861927 4185 heartbeater.cc:347] Connected to a master server at 127.3.217.190:34063
I20260618 23:19:30.862157 4185 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:30.862490 4185 heartbeater.cc:511] Master 127.3.217.190:34063 requested a full tablet report, sending...
I20260618 23:19:30.863487 3994 ts_manager.cc:194] Registered new tserver with Master: 3699440e1cfa463ea05a9acdd8059089 (127.3.217.129:39775)
I20260618 23:19:30.864146 3994 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:37709
WARNING: no policy specified for kudu/127.3.217.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
I20260618 23:19:30.888419 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34063
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:37873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:30.981032 4190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:30.981277 4190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:30.981326 4190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:30.982762 4190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:30.982844 4190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:30.982987 4190 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:19:30.984774 4190 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:37873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34063
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:30.985263 4190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:30.985538 4190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:30.992322 4196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:30.992336 4195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:30.992322 4198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:30.992895 4190 server_base.cc:1034] running on GCE node
I20260618 23:19:30.993404 4190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:30.993683 4190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:30.994817 4190 hybrid_clock.cc:648] HybridClock initialized: now 1781824770994804 us; error 36 us; skew 500 ppm
Jun 18 23:19:30 dist-test-slave-r9ct krb5kdc[3949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824770, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:30.997484 4190 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:19:30.998049 4190 webserver.cc:460] Webserver started at http://127.3.217.130:39367/ using document root <none> and password file <none>
I20260618 23:19:30.998299 4190 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:30.998368 4190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:30.998505 4190 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:30.999676 4190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "7f18dd1cd52f4241b820a05b386b184d"
format_stamp: "Formatted at 2026-06-18 23:19:30 on dist-test-slave-r9ct"
server_key: "6804cb7d5b73805e63c96973fa1f9ef5"
server_key_iv: "bde64ef30ce98eab1c039b50e7de0970"
server_key_version: "encryptionkey@0"
I20260618 23:19:31.000079 4190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "7f18dd1cd52f4241b820a05b386b184d"
format_stamp: "Formatted at 2026-06-18 23:19:30 on dist-test-slave-r9ct"
server_key: "6804cb7d5b73805e63c96973fa1f9ef5"
server_key_iv: "bde64ef30ce98eab1c039b50e7de0970"
server_key_version: "encryptionkey@0"
I20260618 23:19:31.001820 4190 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260618 23:19:31.003276 4205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:31.003531 4190 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:31.003672 4190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "7f18dd1cd52f4241b820a05b386b184d"
format_stamp: "Formatted at 2026-06-18 23:19:30 on dist-test-slave-r9ct"
server_key: "6804cb7d5b73805e63c96973fa1f9ef5"
server_key_iv: "bde64ef30ce98eab1c039b50e7de0970"
server_key_version: "encryptionkey@0"
I20260618 23:19:31.003779 4190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:31.022485 4190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:31.025377 4190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:31.025559 4190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:31.025823 4190 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:31.026144 4190 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:31.026198 4190 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:31.026238 4190 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:31.026265 4190 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:31.036316 4190 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:40613
I20260618 23:19:31.036492 4318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:40613 every 8 connection(s)
I20260618 23:19:31.036815 4190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:19:31.045013 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 4190
I20260618 23:19:31.045100 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
Jun 18 23:19:31 dist-test-slave-r9ct krb5kdc[3949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824770, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:31.045290 3942 external_mini_cluster.cc:1428] Setting key 422ee1577159aa7449e34359d035b4df
I20260618 23:19:31.050226 4321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:31.037612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:34063 (local address 127.3.217.130:53737)
0618 23:19:31.037873 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:31.037918 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:31.038412 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:31.039142 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:31.039146 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:31.039719 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:31.039929 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:31.039934 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:31.041319 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:31.041320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:31.042117 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:31.042119 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:31.043029 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:31.043030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:31.043143 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:31.043822 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:31.043831 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:31.045587 (+ 1756us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:31.048346 (+ 2759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:31.048372 (+ 26us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:31.048375 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:31.048834 (+ 459us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:31.049127 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:31.049129 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:31.049129 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:31.049272 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:31.049623 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:31.049629 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:31.049804 (+ 175us) client_negotiation.cc:769] Sending connection context
0618 23:19:31.049899 (+ 95us) client_negotiation.cc:240] Negotiation successful
0618 23:19:31.050057 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":98,"threads_started":1}
I20260618 23:19:31.050235 4033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:31.037641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:53737 (local address 127.3.217.190:34063)
0618 23:19:31.037822 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:31.037824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:31.038084 (+ 260us) server_negotiation.cc:407] Connection header received
0618 23:19:31.038615 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:31.038616 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:31.038626 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:31.039075 (+ 449us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:31.040197 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:31.040874 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:31.042591 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:31.042880 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:31.042955 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:31.045696 (+ 2741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:31.045698 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:31.045698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:31.045706 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:31.048163 (+ 2457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:31.048950 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:31.048951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:31.048952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:31.049027 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:31.049366 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:31.049367 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:31.049367 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:31.049481 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:31.049547 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:31.049992 (+ 445us) server_negotiation.cc:299] Negotiation successful
0618 23:19:31.050090 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260618 23:19:31.050943 4319 heartbeater.cc:347] Connected to a master server at 127.3.217.190:34063
I20260618 23:19:31.051062 4319 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:31.051254 4319 heartbeater.cc:511] Master 127.3.217.190:34063 requested a full tablet report, sending...
I20260618 23:19:31.052064 3994 ts_manager.cc:194] Registered new tserver with Master: 7f18dd1cd52f4241b820a05b386b184d (127.3.217.130:40613)
I20260618 23:19:31.052722 3994 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:53737
WARNING: no policy specified for kudu/127.3.217.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
I20260618 23:19:31.080163 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34063
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:37873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:31.182479 4324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:31.182866 4324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:31.182969 4324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:31.184767 4324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:31.184856 4324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:31.184908 4324 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:19:31.186893 4324 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:37873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34063
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4324
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:31.187214 4324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:31.187480 4324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:31.194967 4330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:31.194981 4329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:31.195264 4332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:31.195647 4324 server_base.cc:1034] running on GCE node
I20260618 23:19:31.195912 4324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:31.196164 4324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:31.197482 4324 hybrid_clock.cc:648] HybridClock initialized: now 1781824771197564 us; error 134 us; skew 500 ppm
Jun 18 23:19:31 dist-test-slave-r9ct krb5kdc[3949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824771, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:31.200636 4324 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:19:31.201180 4324 webserver.cc:460] Webserver started at http://127.3.217.131:36539/ using document root <none> and password file <none>
I20260618 23:19:31.201398 4324 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:31.201440 4324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:31.201529 4324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:31.202548 4324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "898c9112a8114933844bb7b979c4eb07"
format_stamp: "Formatted at 2026-06-18 23:19:31 on dist-test-slave-r9ct"
server_key: "1ab1364f41b9ff8d4cfb799b4cff8c5c"
server_key_iv: "e28b5b0c4d9c32e913b6f10498de1333"
server_key_version: "encryptionkey@0"
I20260618 23:19:31.203153 4324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "898c9112a8114933844bb7b979c4eb07"
format_stamp: "Formatted at 2026-06-18 23:19:31 on dist-test-slave-r9ct"
server_key: "1ab1364f41b9ff8d4cfb799b4cff8c5c"
server_key_iv: "e28b5b0c4d9c32e913b6f10498de1333"
server_key_version: "encryptionkey@0"
I20260618 23:19:31.205360 4324 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260618 23:19:31.206938 4339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:31.207814 4324 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260618 23:19:31.207916 4324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "898c9112a8114933844bb7b979c4eb07"
format_stamp: "Formatted at 2026-06-18 23:19:31 on dist-test-slave-r9ct"
server_key: "1ab1364f41b9ff8d4cfb799b4cff8c5c"
server_key_iv: "e28b5b0c4d9c32e913b6f10498de1333"
server_key_version: "encryptionkey@0"
I20260618 23:19:31.207969 4324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:31.227466 4324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:31.230044 4324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:31.230166 4324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:31.230360 4324 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:31.230818 4324 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:31.230908 4324 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:31.230947 4324 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:31.230994 4324 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:31.240046 4324 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:36775
I20260618 23:19:31.240091 4452 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:36775 every 8 connection(s)
I20260618 23:19:31.240475 4324 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:19:31.247349 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 4324
I20260618 23:19:31.247460 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:19:31.247615 3942 external_mini_cluster.cc:1428] Setting key 309b1c656b93d5a766d153b166d5a676
Jun 18 23:19:31 dist-test-slave-r9ct krb5kdc[3949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824771, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:31.254079 4033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:31.241251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:49531 (local address 127.3.217.190:34063)
0618 23:19:31.241413 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:31.241415 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:31.241573 (+ 158us) server_negotiation.cc:407] Connection header received
0618 23:19:31.242126 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:31.242126 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:31.242138 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:31.242187 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:31.243197 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:31.243714 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:31.244897 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:31.245102 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:31.245196 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:31.249001 (+ 3805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:31.249002 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:31.249003 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:31.249011 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:31.251694 (+ 2683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:31.252623 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:31.252624 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:31.252625 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:31.252698 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:31.253311 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:31.253312 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:31.253312 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:31.253479 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:31.253568 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:31.253897 (+ 329us) server_negotiation.cc:299] Negotiation successful
0618 23:19:31.253986 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
I20260618 23:19:31.254276 4455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:31.241165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:34063 (local address 127.3.217.131:49531)
0618 23:19:31.241427 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:31.241480 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:31.242008 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:31.242275 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:31.242278 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:31.242905 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:31.243096 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:31.243100 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:31.243826 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:31.243827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:31.244632 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:31.244634 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:31.245226 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:31.245227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:31.245370 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:31.246110 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:31.246118 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:31.248826 (+ 2708us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:31.252067 (+ 3241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:31.252075 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:31.252077 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:31.252408 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:31.252831 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:31.252832 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:31.252832 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:31.253204 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:31.253572 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:31.253579 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:31.253713 (+ 134us) client_negotiation.cc:769] Sending connection context
0618 23:19:31.253855 (+ 142us) client_negotiation.cc:240] Negotiation successful
0618 23:19:31.254029 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":89,"threads_started":1}
I20260618 23:19:31.255189 4453 heartbeater.cc:347] Connected to a master server at 127.3.217.190:34063
I20260618 23:19:31.255370 4453 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:31.255586 4453 heartbeater.cc:511] Master 127.3.217.190:34063 requested a full tablet report, sending...
I20260618 23:19:31.256285 3994 ts_manager.cc:194] Registered new tserver with Master: 898c9112a8114933844bb7b979c4eb07 (127.3.217.131:36775)
I20260618 23:19:31.256718 3994 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:49531
I20260618 23:19:31.261042 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 18 23:19:31 dist-test-slave-r9ct krb5kdc[3949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824771, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 18 23:19:31 dist-test-slave-r9ct krb5kdc[3949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824771, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.3.217.129@KRBTEST.COM
I20260618 23:19:31.289564 4460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:31.278560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52412 (local address 127.3.217.129:39775)
0618 23:19:31.279031 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:31.279037 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:31.279048 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:19:31.279080 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:31.279082 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:31.279098 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:31.279208 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:31.279988 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:31.280724 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:31.281483 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:31.281807 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:31.281895 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:31.284868 (+ 2973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:31.284875 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:31.284876 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:31.284882 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:31.287315 (+ 2433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:31.288018 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:31.288021 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:31.288021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:31.288084 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:31.288408 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:31.288409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:31.288409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:31.288756 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:31.289041 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:31.289371 (+ 330us) server_negotiation.cc:299] Negotiation successful
0618 23:19:31.289476 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":228,"threads_started":1}
W20260618 23:19:31.290653 4099 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52412
Jun 18 23:19:31 dist-test-slave-r9ct krb5kdc[3949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824771, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 18 23:19:31 dist-test-slave-r9ct krb5kdc[3949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824771, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.129@KRBTEST.COM
I20260618 23:19:31.318302 4460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:31.309792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52424 (local address 127.3.217.129:39775)
0618 23:19:31.309906 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:31.309909 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:31.309921 (+ 12us) server_negotiation.cc:407] Connection header received
0618 23:19:31.309956 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:31.309957 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:31.309972 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:31.310096 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:31.310927 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:31.311502 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:31.312388 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:31.312585 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:31.312645 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:31.315512 (+ 2867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:31.315513 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:31.315513 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:31.315523 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:31.317103 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:31.317486 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:31.317487 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:31.317487 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:31.317547 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:31.317750 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:31.317751 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:31.317751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:31.317854 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:31.317985 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:31.318100 (+ 115us) server_negotiation.cc:299] Negotiation successful
0618 23:19:31.318185 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260618 23:19:31.319694 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 4056
I20260618 23:19:31.325002 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 4190
I20260618 23:19:31.330843 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 4324
I20260618 23:19:31.335180 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 3962
2026-06-18T23:19:31Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2058 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:19:31 dist-test-slave-r9ct krb5kdc[4467](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:19:31 dist-test-slave-r9ct krb5kdc[4467](info): set up 2 sockets
Jun 18 23:19:31 dist-test-slave-r9ct krb5kdc[4467](info): commencing operation
krb5kdc: starting...
W20260618 23:19:32.447018 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.089s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:19:32 dist-test-slave-r9ct krb5kdc[4467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824772, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:19:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:19:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:19:32.591043 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:39619
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:46675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:39619
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:32.677414 4480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:32.677634 4480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:32.677656 4480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:32.678913 4480 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:19:32.678958 4480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:32.678972 4480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:32.678985 4480 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:19:32.678998 4480 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:19:32.680728 4480 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:46675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:39619
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:39619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4480
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:32.681185 4480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:32.681452 4480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:32.687340 4486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:32.687467 4485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:32.687629 4480 server_base.cc:1034] running on GCE node
W20260618 23:19:32.687340 4488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:32.687978 4480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:32.688306 4480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:32.689471 4480 hybrid_clock.cc:648] HybridClock initialized: now 1781824772689425 us; error 61 us; skew 500 ppm
Jun 18 23:19:32 dist-test-slave-r9ct krb5kdc[4467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824772, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:32.692263 4480 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:19:32.692711 4480 webserver.cc:460] Webserver started at http://127.3.217.190:39305/ using document root <none> and password file <none>
I20260618 23:19:32.692955 4480 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:32.693002 4480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:32.693125 4480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:32.694191 4480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "3321ed2219dc4177bfbc09861348e015"
format_stamp: "Formatted at 2026-06-18 23:19:32 on dist-test-slave-r9ct"
server_key: "30dfdc14a8d971488be322f306a2e591"
server_key_iv: "2f269a7d7ef1b523fe1ca6325499d9ae"
server_key_version: "encryptionkey@0"
I20260618 23:19:32.694561 4480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "3321ed2219dc4177bfbc09861348e015"
format_stamp: "Formatted at 2026-06-18 23:19:32 on dist-test-slave-r9ct"
server_key: "30dfdc14a8d971488be322f306a2e591"
server_key_iv: "2f269a7d7ef1b523fe1ca6325499d9ae"
server_key_version: "encryptionkey@0"
I20260618 23:19:32.696071 4480 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:19:32.697124 4495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:32.697747 4480 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:32.697849 4480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "3321ed2219dc4177bfbc09861348e015"
format_stamp: "Formatted at 2026-06-18 23:19:32 on dist-test-slave-r9ct"
server_key: "30dfdc14a8d971488be322f306a2e591"
server_key_iv: "2f269a7d7ef1b523fe1ca6325499d9ae"
server_key_version: "encryptionkey@0"
I20260618 23:19:32.697930 4480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:32.713627 4480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:32.715867 4480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:32.715979 4480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:32.720572 4480 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:39619
I20260618 23:19:32.720602 4547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:39619 every 8 connection(s)
I20260618 23:19:32.721230 4480 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:19:32.722529 4548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:32.726420 4548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015: Bootstrap starting.
I20260618 23:19:32.726585 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 4480
I20260618 23:19:32.726750 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:19:32.726936 3942 external_mini_cluster.cc:1428] Setting key 1af5f63e82f35b62a1c908d92c88cfbb
I20260618 23:19:32.727406 4548 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:32.727880 4548 log.cc:824] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:32.728734 4548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015: No bootstrap required, opened a new log
I20260618 23:19:32.731768 4548 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3321ed2219dc4177bfbc09861348e015" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 39619 } }
I20260618 23:19:32.732048 4548 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:32.732164 4548 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3321ed2219dc4177bfbc09861348e015, State: Initialized, Role: FOLLOWER
I20260618 23:19:32.732404 4548 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3321ed2219dc4177bfbc09861348e015" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 39619 } }
I20260618 23:19:32.732640 4548 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:19:32.732708 4548 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:19:32.732776 4548 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:32.733827 4548 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3321ed2219dc4177bfbc09861348e015" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 39619 } }
I20260618 23:19:32.733961 4548 leader_election.cc:302] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3321ed2219dc4177bfbc09861348e015; no voters:
I20260618 23:19:32.734189 4548 leader_election.cc:288] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:19:32.734298 4553 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:32.734498 4548 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:19:32.734495 4553 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015 [term 1 LEADER]: Becoming Leader. State: Replica: 3321ed2219dc4177bfbc09861348e015, State: Running, Role: LEADER
I20260618 23:19:32.734704 4553 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3321ed2219dc4177bfbc09861348e015" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 39619 } }
I20260618 23:19:32.735138 4555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3321ed2219dc4177bfbc09861348e015" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3321ed2219dc4177bfbc09861348e015" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 39619 } } }
I20260618 23:19:32.735140 4554 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3321ed2219dc4177bfbc09861348e015. Latest consensus state: current_term: 1 leader_uuid: "3321ed2219dc4177bfbc09861348e015" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3321ed2219dc4177bfbc09861348e015" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 39619 } } }
I20260618 23:19:32.735368 4554 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015 [sys.catalog]: This master's current role is: LEADER
Jun 18 23:19:32 dist-test-slave-r9ct krb5kdc[4467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824772, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:32.735553 4555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015 [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:32.735797 4562 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:19:32.736640 4562 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:19:32.738579 4562 catalog_manager.cc:1347] Generated new cluster ID: ebc0d702042f4ab9ba7a78bfe8de29ea
I20260618 23:19:32.738628 4562 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:19:32.740468 4551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:32.727790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34208 (local address 127.3.217.190:39619)
0618 23:19:32.728098 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:32.728109 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:32.728149 (+ 40us) server_negotiation.cc:407] Connection header received
0618 23:19:32.729136 (+ 987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:32.729149 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:32.729229 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:32.729471 (+ 242us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:32.730122 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:32.731153 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:32.732202 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:32.732856 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:32.732966 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:32.736046 (+ 3080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:32.736051 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:32.736052 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:32.736066 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:32.738060 (+ 1994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:32.738528 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:32.738540 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:32.738541 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:32.738646 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:32.738928 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:32.738930 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:32.738930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:32.739242 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:32.739731 (+ 489us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:32.739857 (+ 126us) server_negotiation.cc:299] Negotiation successful
0618 23:19:32.740067 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":106,"threads_started":1}
I20260618 23:19:32.757251 4562 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:19:32.757969 4562 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:19:32.763007 4562 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3321ed2219dc4177bfbc09861348e015: Generated new TSK 0
I20260618 23:19:32.763191 4562 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.217.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
I20260618 23:19:32.798689 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:39619
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:46675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:32.888020 4574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:32.888307 4574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:32.888339 4574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:32.890618 4574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:32.890734 4574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:32.890780 4574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:19:32.892460 4574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:46675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:39619
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4574
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:32.892663 4574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:32.892848 4574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:32.898062 4580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:32.898085 4582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:32.898182 4579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:32.898546 4574 server_base.cc:1034] running on GCE node
I20260618 23:19:32.898839 4574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:32.899142 4574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:32.900341 4574 hybrid_clock.cc:648] HybridClock initialized: now 1781824772900295 us; error 66 us; skew 500 ppm
Jun 18 23:19:32 dist-test-slave-r9ct krb5kdc[4467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824772, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:32.904244 4574 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:19:32.904851 4574 webserver.cc:460] Webserver started at http://127.3.217.129:44275/ using document root <none> and password file <none>
I20260618 23:19:32.905236 4574 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:32.905361 4574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:32.905535 4574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:32.906670 4574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "2ea8ae17c8ce4c78a0729b03287be400"
format_stamp: "Formatted at 2026-06-18 23:19:32 on dist-test-slave-r9ct"
server_key: "037a626560decc34b4228d8e5c485df7"
server_key_iv: "e5154714ff0a91c1ae263e09cae687fc"
server_key_version: "encryptionkey@0"
I20260618 23:19:32.907161 4574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "2ea8ae17c8ce4c78a0729b03287be400"
format_stamp: "Formatted at 2026-06-18 23:19:32 on dist-test-slave-r9ct"
server_key: "037a626560decc34b4228d8e5c485df7"
server_key_iv: "e5154714ff0a91c1ae263e09cae687fc"
server_key_version: "encryptionkey@0"
I20260618 23:19:32.908710 4574 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260618 23:19:32.909871 4589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:32.910202 4574 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:32.910372 4574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "2ea8ae17c8ce4c78a0729b03287be400"
format_stamp: "Formatted at 2026-06-18 23:19:32 on dist-test-slave-r9ct"
server_key: "037a626560decc34b4228d8e5c485df7"
server_key_iv: "e5154714ff0a91c1ae263e09cae687fc"
server_key_version: "encryptionkey@0"
I20260618 23:19:32.910459 4574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:32.922080 4574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:32.925122 4574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:32.925295 4574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:32.925534 4574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:32.925889 4574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:32.925951 4574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:32.925992 4574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:32.926018 4574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:32.932358 4574 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:43353
I20260618 23:19:32.932504 4702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:43353 every 8 connection(s)
I20260618 23:19:32.932761 4574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:19:32.934315 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 4574
I20260618 23:19:32.934440 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:19:32.934636 3942 external_mini_cluster.cc:1428] Setting key 2950484f4af4e61e9e08a7a4766277dd
Jun 18 23:19:32 dist-test-slave-r9ct krb5kdc[4467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824772, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.3.217.130@KRBTEST.COM; defaulting to no policy
I20260618 23:19:32.945721 4551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:32.933514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:45071 (local address 127.3.217.190:39619)
0618 23:19:32.933558 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:32.933560 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:32.933764 (+ 204us) server_negotiation.cc:407] Connection header received
0618 23:19:32.935090 (+ 1326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:32.935092 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:32.935103 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:32.935184 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:32.935964 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:32.936751 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:32.938527 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:32.938736 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:32.938972 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:32.941637 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:32.941639 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:32.941640 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:32.941647 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:32.944211 (+ 2564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:32.944688 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:32.944689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:32.944690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:32.944752 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:32.945032 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:32.945033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:32.945033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:32.945156 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:32.945236 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:32.945518 (+ 282us) server_negotiation.cc:299] Negotiation successful
0618 23:19:32.945606 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260618 23:19:32.945940 4705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:32.933464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:39619 (local address 127.3.217.129:45071)
0618 23:19:32.933616 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:32.933657 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:32.934912 (+ 1255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:32.935269 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:32.935273 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:32.935638 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:32.935865 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:32.935869 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:32.936921 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:32.936922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:32.938310 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:32.938312 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:32.938978 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:32.938980 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:32.939134 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:32.939825 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:32.939837 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:32.941528 (+ 1691us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:32.944351 (+ 2823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:32.944358 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:32.944360 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:32.944589 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:32.944823 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:32.944824 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:32.944824 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:32.944951 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:32.945227 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:32.945233 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:32.945383 (+ 150us) client_negotiation.cc:769] Sending connection context
0618 23:19:32.945497 (+ 114us) client_negotiation.cc:240] Negotiation successful
0618 23:19:32.945675 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":89,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.130@KRBTEST.COM" created.
I20260618 23:19:32.946877 4703 heartbeater.cc:347] Connected to a master server at 127.3.217.190:39619
I20260618 23:19:32.947012 4703 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:32.947230 4703 heartbeater.cc:511] Master 127.3.217.190:39619 requested a full tablet report, sending...
I20260618 23:19:32.948055 4512 ts_manager.cc:194] Registered new tserver with Master: 2ea8ae17c8ce4c78a0729b03287be400 (127.3.217.129:43353)
I20260618 23:19:32.948732 4512 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:45071
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
I20260618 23:19:32.968470 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:39619
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:46675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:33.054505 4708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:33.054702 4708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:33.054805 4708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:33.056253 4708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:33.056306 4708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:33.056344 4708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:19:33.057957 4708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:46675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:39619
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4708
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:33.058207 4708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:33.058563 4708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:33.064114 4713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:33.064127 4716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:33.064183 4708 server_base.cc:1034] running on GCE node
W20260618 23:19:33.064092 4714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:33.064570 4708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:33.064832 4708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:33.066012 4708 hybrid_clock.cc:648] HybridClock initialized: now 1781824773065976 us; error 54 us; skew 500 ppm
Jun 18 23:19:33 dist-test-slave-r9ct krb5kdc[4467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824773, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:33.068866 4708 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:19:33.069639 4708 webserver.cc:460] Webserver started at http://127.3.217.130:42489/ using document root <none> and password file <none>
I20260618 23:19:33.069964 4708 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:33.070024 4708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:33.070286 4708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:33.071472 4708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "1281ab608ad44078a08b34db69e23d34"
format_stamp: "Formatted at 2026-06-18 23:19:33 on dist-test-slave-r9ct"
server_key: "c60fb826ed14528f638ccb755ffee350"
server_key_iv: "9153955d88da42a4ba7185aba44931e4"
server_key_version: "encryptionkey@0"
I20260618 23:19:33.071826 4708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "1281ab608ad44078a08b34db69e23d34"
format_stamp: "Formatted at 2026-06-18 23:19:33 on dist-test-slave-r9ct"
server_key: "c60fb826ed14528f638ccb755ffee350"
server_key_iv: "9153955d88da42a4ba7185aba44931e4"
server_key_version: "encryptionkey@0"
I20260618 23:19:33.073303 4708 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260618 23:19:33.074203 4723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:33.074606 4708 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:33.074687 4708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "1281ab608ad44078a08b34db69e23d34"
format_stamp: "Formatted at 2026-06-18 23:19:33 on dist-test-slave-r9ct"
server_key: "c60fb826ed14528f638ccb755ffee350"
server_key_iv: "9153955d88da42a4ba7185aba44931e4"
server_key_version: "encryptionkey@0"
I20260618 23:19:33.074820 4708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:33.087630 4708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:33.089991 4708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:33.090140 4708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:33.090392 4708 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:33.090726 4708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:33.090785 4708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:33.090818 4708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:33.090919 4708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:33.097294 4708 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:41867
I20260618 23:19:33.097343 4836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:41867 every 8 connection(s)
I20260618 23:19:33.097693 4708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:19:33.104405 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 4708
I20260618 23:19:33.104511 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:19:33.104807 3942 external_mini_cluster.cc:1428] Setting key ec25920cc73e78a549a6e15f75d4c97a
Jun 18 23:19:33 dist-test-slave-r9ct krb5kdc[4467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824773, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:33.110096 4551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:33.098546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:53169 (local address 127.3.217.190:39619)
0618 23:19:33.098607 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:33.098609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:33.098842 (+ 233us) server_negotiation.cc:407] Connection header received
0618 23:19:33.099715 (+ 873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:33.099717 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:33.099726 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:33.099890 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:33.100728 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.101323 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.103002 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.103288 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.103363 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:33.106419 (+ 3056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:33.106421 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:33.106421 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:33.106429 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:33.108287 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:33.108746 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:33.108748 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:33.108748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:33.108855 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:33.109399 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:33.109400 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:33.109400 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:33.109535 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:33.109631 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:33.109918 (+ 287us) server_negotiation.cc:299] Negotiation successful
0618 23:19:33.110002 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260618 23:19:33.110325 4839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:33.098416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:39619 (local address 127.3.217.130:53169)
0618 23:19:33.098594 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:33.098637 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:33.099577 (+ 940us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:33.099978 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:33.099981 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:33.100239 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:33.100469 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:33.100473 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.101427 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.101428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:33.102835 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:33.102841 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.103404 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.103405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:33.103536 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:33.104455 (+ 919us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:33.104463 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:33.106304 (+ 1841us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:33.108409 (+ 2105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:33.108415 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:33.108417 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:33.108645 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:33.109045 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:33.109046 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:33.109047 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:33.109268 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:33.109625 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:33.109631 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:33.109774 (+ 143us) client_negotiation.cc:769] Sending connection context
0618 23:19:33.109894 (+ 120us) client_negotiation.cc:240] Negotiation successful
0618 23:19:33.110064 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":106,"threads_started":1}
I20260618 23:19:33.110890 4837 heartbeater.cc:347] Connected to a master server at 127.3.217.190:39619
I20260618 23:19:33.110981 4837 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:33.111166 4837 heartbeater.cc:511] Master 127.3.217.190:39619 requested a full tablet report, sending...
I20260618 23:19:33.111567 4512 ts_manager.cc:194] Registered new tserver with Master: 1281ab608ad44078a08b34db69e23d34 (127.3.217.130:41867)
I20260618 23:19:33.112313 4512 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:53169
WARNING: no policy specified for kudu/127.3.217.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
I20260618 23:19:33.134558 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:39619
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:46675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:33.221246 4842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:33.221508 4842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:33.221534 4842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:33.223529 4842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:33.223618 4842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:33.223665 4842 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:19:33.225623 4842 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:46675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:39619
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4842
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:33.225853 4842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:33.226035 4842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:33.232239 4847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:33.232409 4848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:33.232756 4850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:33.232559 4842 server_base.cc:1034] running on GCE node
I20260618 23:19:33.233496 4842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:33.233999 4842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:33.235248 4842 hybrid_clock.cc:648] HybridClock initialized: now 1781824773235221 us; error 52 us; skew 500 ppm
Jun 18 23:19:33 dist-test-slave-r9ct krb5kdc[4467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824773, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:33.238760 4842 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:19:33.239372 4842 webserver.cc:460] Webserver started at http://127.3.217.131:35523/ using document root <none> and password file <none>
I20260618 23:19:33.239620 4842 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:33.239696 4842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:33.239837 4842 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:33.241014 4842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "82d6251d04d84b5e82cb836e31f1a762"
format_stamp: "Formatted at 2026-06-18 23:19:33 on dist-test-slave-r9ct"
server_key: "5d08b507becf2a70a3b519f508770135"
server_key_iv: "528eed98fcc7e31a05361a84404b6cfa"
server_key_version: "encryptionkey@0"
I20260618 23:19:33.241380 4842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "82d6251d04d84b5e82cb836e31f1a762"
format_stamp: "Formatted at 2026-06-18 23:19:33 on dist-test-slave-r9ct"
server_key: "5d08b507becf2a70a3b519f508770135"
server_key_iv: "528eed98fcc7e31a05361a84404b6cfa"
server_key_version: "encryptionkey@0"
I20260618 23:19:33.242786 4842 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:19:33.243610 4857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:33.243794 4842 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:33.243902 4842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "82d6251d04d84b5e82cb836e31f1a762"
format_stamp: "Formatted at 2026-06-18 23:19:33 on dist-test-slave-r9ct"
server_key: "5d08b507becf2a70a3b519f508770135"
server_key_iv: "528eed98fcc7e31a05361a84404b6cfa"
server_key_version: "encryptionkey@0"
I20260618 23:19:33.243993 4842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:33.251116 4842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:33.253193 4842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:33.253412 4842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:33.253643 4842 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:33.253976 4842 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:33.254034 4842 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:33.254076 4842 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:33.254101 4842 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:33.261976 4842 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:46679
I20260618 23:19:33.262012 4970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:46679 every 8 connection(s)
I20260618 23:19:33.262395 4842 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
Jun 18 23:19:33 dist-test-slave-r9ct krb5kdc[4467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824773, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:33.270654 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 4842
I20260618 23:19:33.270829 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:19:33.271003 3942 external_mini_cluster.cc:1428] Setting key 77229f2d94e5005a899f33df225d2b1f
I20260618 23:19:33.273773 4551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:33.263263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:46333 (local address 127.3.217.190:39619)
0618 23:19:33.263340 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:33.263343 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:33.263772 (+ 429us) server_negotiation.cc:407] Connection header received
0618 23:19:33.264781 (+ 1009us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:33.264782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:33.264792 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:33.264854 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:33.265495 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.266024 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.267148 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.267360 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.267428 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:33.269640 (+ 2212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:33.269642 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:33.269642 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:33.269648 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:33.271491 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:33.272426 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:33.272428 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:33.272429 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:33.272514 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:33.273099 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:33.273101 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:33.273101 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:33.273228 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:33.273365 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:33.273614 (+ 249us) server_negotiation.cc:299] Negotiation successful
0618 23:19:33.273677 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260618 23:19:33.273903 4973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:33.263228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:39619 (local address 127.3.217.131:46333)
0618 23:19:33.263486 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:33.263578 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:33.264661 (+ 1083us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:33.264957 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:33.264961 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:33.265213 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:33.265398 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:33.265402 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.266118 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.266119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:33.267068 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:33.267071 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.267442 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.267442 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:33.267536 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:33.268082 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:33.268090 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:33.269540 (+ 1450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:33.271681 (+ 2141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:33.271694 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:33.271698 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:33.272283 (+ 585us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:33.272653 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:33.272655 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:33.272655 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:33.272877 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:33.273360 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:33.273365 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:33.273482 (+ 117us) client_negotiation.cc:769] Sending connection context
0618 23:19:33.273573 (+ 91us) client_negotiation.cc:240] Negotiation successful
0618 23:19:33.273699 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":95,"threads_started":1}
I20260618 23:19:33.274386 4971 heartbeater.cc:347] Connected to a master server at 127.3.217.190:39619
I20260618 23:19:33.274466 4971 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:33.274595 4971 heartbeater.cc:511] Master 127.3.217.190:39619 requested a full tablet report, sending...
I20260618 23:19:33.274981 4512 ts_manager.cc:194] Registered new tserver with Master: 82d6251d04d84b5e82cb836e31f1a762 (127.3.217.131:46679)
I20260618 23:19:33.275324 4512 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:46333
I20260618 23:19:33.284113 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260618 23:19:33.292996 4551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:33.285963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34214 (local address 127.3.217.190:39619)
0618 23:19:33.286035 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:33.286037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:33.286197 (+ 160us) server_negotiation.cc:407] Connection header received
0618 23:19:33.286220 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:33.286221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:33.286245 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:33.286310 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:33.286916 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.287405 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.288299 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.288501 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.288581 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:33.289908 (+ 1327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:33.289909 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:33.289909 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:33.289915 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:33.291529 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:33.291935 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:33.291936 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:33.291937 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:33.292008 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:33.292329 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:33.292330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:33.292331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:33.292577 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:33.292671 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:33.292860 (+ 189us) server_negotiation.cc:299] Negotiation successful
0618 23:19:33.292930 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260618 23:19:33.295619 4512 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34214:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:19:33.297238 4512 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:19:33.304729 4984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:33.300108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:46679 (local address 127.0.0.1:50996)
0618 23:19:33.300505 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:33.300568 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:33.300698 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:33.301195 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:33.301196 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:33.301199 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:33.301270 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:33.301272 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.302237 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.302239 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:33.303665 (+ 1426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:33.303669 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.304447 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.304448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:33.304520 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:33.304531 (+ 11us) client_negotiation.cc:769] Sending connection context
0618 23:19:33.304616 (+ 85us) client_negotiation.cc:240] Negotiation successful
0618 23:19:33.304671 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"mutex_wait_us":5,"thread_start_us":121,"threads_started":1}
I20260618 23:19:33.304786 4986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:33.300397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50996 (local address 127.3.217.131:46679)
0618 23:19:33.300661 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:33.300664 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:33.300675 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:19:33.300975 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:33.300980 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:33.301000 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:33.301074 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:33.301327 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.302143 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.303786 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.304341 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.304410 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:33.304449 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:33.304654 (+ 205us) server_negotiation.cc:299] Negotiation successful
0618 23:19:33.304700 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":106,"threads_started":1}
I20260618 23:19:33.305550 4982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:33.300162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:43353 (local address 127.0.0.1:47610)
0618 23:19:33.300655 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:33.300664 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:33.300749 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:33.301060 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:33.301063 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:33.301066 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:33.301135 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:33.301138 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.302450 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.302451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:33.303669 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:33.303671 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.305255 (+ 1584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.305256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:33.305370 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:33.305374 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:19:33.305434 (+ 60us) client_negotiation.cc:240] Negotiation successful
0618 23:19:33.305486 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"mutex_wait_us":24,"thread_start_us":70,"threads_started":1}
I20260618 23:19:33.305665 4905 tablet_service.cc:1467] Processing CreateTablet for tablet 85aaaf1ca5ea43cd96e939932c090cab (DEFAULT_TABLE table=test-table [id=2d698cec64b344ae99db5d1fa21b25ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:33.305955 4985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:33.300409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47610 (local address 127.3.217.129:43353)
0618 23:19:33.300583 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:33.300588 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:33.300779 (+ 191us) server_negotiation.cc:407] Connection header received
0618 23:19:33.300827 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:33.300829 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:33.300848 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:33.300943 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:33.301217 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.302335 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.304480 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.305165 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.305245 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:33.305320 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:33.305835 (+ 515us) server_negotiation.cc:299] Negotiation successful
0618 23:19:33.305882 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":78,"threads_started":1}
I20260618 23:19:33.306069 4905 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85aaaf1ca5ea43cd96e939932c090cab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:33.306510 4983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:33.300266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:41867 (local address 127.0.0.1:36454)
0618 23:19:33.300832 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:33.300840 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:33.300891 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:33.301274 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:33.301275 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:33.301278 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:33.301324 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:33.301325 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.302533 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.302534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:33.303673 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:33.303675 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.306269 (+ 2594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.306270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:33.306323 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:33.306327 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:19:33.306402 (+ 75us) client_negotiation.cc:240] Negotiation successful
0618 23:19:33.306445 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"mutex_wait_us":6,"thread_start_us":122,"threads_started":1}
I20260618 23:19:33.306522 4637 tablet_service.cc:1467] Processing CreateTablet for tablet 85aaaf1ca5ea43cd96e939932c090cab (DEFAULT_TABLE table=test-table [id=2d698cec64b344ae99db5d1fa21b25ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:33.306526 4987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:33.300398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36454 (local address 127.3.217.130:41867)
0618 23:19:33.300828 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:33.300832 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:33.301024 (+ 192us) server_negotiation.cc:407] Connection header received
0618 23:19:33.301065 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:33.301067 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:33.301084 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:33.301163 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:33.301425 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.302450 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.305356 (+ 2906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.306105 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.306173 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:33.306221 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:33.306415 (+ 194us) server_negotiation.cc:299] Negotiation successful
0618 23:19:33.306454 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":113,"threads_started":1}
I20260618 23:19:33.306840 4637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85aaaf1ca5ea43cd96e939932c090cab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:33.310140 4988 tablet_bootstrap.cc:492] T 85aaaf1ca5ea43cd96e939932c090cab P 82d6251d04d84b5e82cb836e31f1a762: Bootstrap starting.
I20260618 23:19:33.310820 4989 tablet_bootstrap.cc:492] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400: Bootstrap starting.
I20260618 23:19:33.310878 4988 tablet_bootstrap.cc:654] T 85aaaf1ca5ea43cd96e939932c090cab P 82d6251d04d84b5e82cb836e31f1a762: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:33.311236 4771 tablet_service.cc:1467] Processing CreateTablet for tablet 85aaaf1ca5ea43cd96e939932c090cab (DEFAULT_TABLE table=test-table [id=2d698cec64b344ae99db5d1fa21b25ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:33.311494 4989 tablet_bootstrap.cc:654] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:33.311477 4988 log.cc:824] T 85aaaf1ca5ea43cd96e939932c090cab P 82d6251d04d84b5e82cb836e31f1a762: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:33.311563 4771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85aaaf1ca5ea43cd96e939932c090cab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:33.312029 4989 log.cc:824] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:33.312383 4988 tablet_bootstrap.cc:492] T 85aaaf1ca5ea43cd96e939932c090cab P 82d6251d04d84b5e82cb836e31f1a762: No bootstrap required, opened a new log
I20260618 23:19:33.312459 4988 ts_tablet_manager.cc:1397] T 85aaaf1ca5ea43cd96e939932c090cab P 82d6251d04d84b5e82cb836e31f1a762: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260618 23:19:33.312809 4989 tablet_bootstrap.cc:492] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400: No bootstrap required, opened a new log
I20260618 23:19:33.313166 4989 ts_tablet_manager.cc:1397] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260618 23:19:33.314288 4988 raft_consensus.cc:348] T 85aaaf1ca5ea43cd96e939932c090cab P 82d6251d04d84b5e82cb836e31f1a762 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1281ab608ad44078a08b34db69e23d34" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41867 } } peers { permanent_uuid: "82d6251d04d84b5e82cb836e31f1a762" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46679 } } peers { permanent_uuid: "2ea8ae17c8ce4c78a0729b03287be400" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43353 } }
I20260618 23:19:33.314517 4988 raft_consensus.cc:374] T 85aaaf1ca5ea43cd96e939932c090cab P 82d6251d04d84b5e82cb836e31f1a762 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:33.314564 4988 raft_consensus.cc:729] T 85aaaf1ca5ea43cd96e939932c090cab P 82d6251d04d84b5e82cb836e31f1a762 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82d6251d04d84b5e82cb836e31f1a762, State: Initialized, Role: FOLLOWER
I20260618 23:19:33.314834 4988 consensus_queue.cc:260] T 85aaaf1ca5ea43cd96e939932c090cab P 82d6251d04d84b5e82cb836e31f1a762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1281ab608ad44078a08b34db69e23d34" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41867 } } peers { permanent_uuid: "82d6251d04d84b5e82cb836e31f1a762" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46679 } } peers { permanent_uuid: "2ea8ae17c8ce4c78a0729b03287be400" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43353 } }
I20260618 23:19:33.315162 4988 ts_tablet_manager.cc:1428] T 85aaaf1ca5ea43cd96e939932c090cab P 82d6251d04d84b5e82cb836e31f1a762: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260618 23:19:33.315364 4971 heartbeater.cc:503] Master 127.3.217.190:39619 was elected leader, sending a full tablet report...
I20260618 23:19:33.316691 4993 tablet_bootstrap.cc:492] T 85aaaf1ca5ea43cd96e939932c090cab P 1281ab608ad44078a08b34db69e23d34: Bootstrap starting.
I20260618 23:19:33.317168 4989 raft_consensus.cc:348] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1281ab608ad44078a08b34db69e23d34" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41867 } } peers { permanent_uuid: "82d6251d04d84b5e82cb836e31f1a762" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46679 } } peers { permanent_uuid: "2ea8ae17c8ce4c78a0729b03287be400" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43353 } }
I20260618 23:19:33.317279 4993 tablet_bootstrap.cc:654] T 85aaaf1ca5ea43cd96e939932c090cab P 1281ab608ad44078a08b34db69e23d34: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:33.317309 4989 raft_consensus.cc:374] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:33.317365 4989 raft_consensus.cc:729] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ea8ae17c8ce4c78a0729b03287be400, State: Initialized, Role: FOLLOWER
I20260618 23:19:33.317502 4989 consensus_queue.cc:260] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1281ab608ad44078a08b34db69e23d34" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41867 } } peers { permanent_uuid: "82d6251d04d84b5e82cb836e31f1a762" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46679 } } peers { permanent_uuid: "2ea8ae17c8ce4c78a0729b03287be400" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43353 } }
I20260618 23:19:33.317768 4703 heartbeater.cc:503] Master 127.3.217.190:39619 was elected leader, sending a full tablet report...
I20260618 23:19:33.317776 4989 ts_tablet_manager.cc:1428] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260618 23:19:33.318146 4993 log.cc:824] T 85aaaf1ca5ea43cd96e939932c090cab P 1281ab608ad44078a08b34db69e23d34: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:33.319903 4993 tablet_bootstrap.cc:492] T 85aaaf1ca5ea43cd96e939932c090cab P 1281ab608ad44078a08b34db69e23d34: No bootstrap required, opened a new log
I20260618 23:19:33.320021 4993 ts_tablet_manager.cc:1397] T 85aaaf1ca5ea43cd96e939932c090cab P 1281ab608ad44078a08b34db69e23d34: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.003s
I20260618 23:19:33.321828 4993 raft_consensus.cc:348] T 85aaaf1ca5ea43cd96e939932c090cab P 1281ab608ad44078a08b34db69e23d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1281ab608ad44078a08b34db69e23d34" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41867 } } peers { permanent_uuid: "82d6251d04d84b5e82cb836e31f1a762" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46679 } } peers { permanent_uuid: "2ea8ae17c8ce4c78a0729b03287be400" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43353 } }
I20260618 23:19:33.322012 4993 raft_consensus.cc:374] T 85aaaf1ca5ea43cd96e939932c090cab P 1281ab608ad44078a08b34db69e23d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:33.322057 4993 raft_consensus.cc:729] T 85aaaf1ca5ea43cd96e939932c090cab P 1281ab608ad44078a08b34db69e23d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1281ab608ad44078a08b34db69e23d34, State: Initialized, Role: FOLLOWER
I20260618 23:19:33.322203 4993 consensus_queue.cc:260] T 85aaaf1ca5ea43cd96e939932c090cab P 1281ab608ad44078a08b34db69e23d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1281ab608ad44078a08b34db69e23d34" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41867 } } peers { permanent_uuid: "82d6251d04d84b5e82cb836e31f1a762" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46679 } } peers { permanent_uuid: "2ea8ae17c8ce4c78a0729b03287be400" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43353 } }
I20260618 23:19:33.322543 4837 heartbeater.cc:503] Master 127.3.217.190:39619 was elected leader, sending a full tablet report...
I20260618 23:19:33.322580 4993 ts_tablet_manager.cc:1428] T 85aaaf1ca5ea43cd96e939932c090cab P 1281ab608ad44078a08b34db69e23d34: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
W20260618 23:19:33.348245 4838 tablet.cc:2369] T 85aaaf1ca5ea43cd96e939932c090cab P 1281ab608ad44078a08b34db69e23d34: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260618 23:19:33.433595 4704 tablet.cc:2369] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 23:19:33.471366 4994 raft_consensus.cc:482] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:19:33.471550 4994 raft_consensus.cc:504] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1281ab608ad44078a08b34db69e23d34" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41867 } } peers { permanent_uuid: "82d6251d04d84b5e82cb836e31f1a762" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46679 } } peers { permanent_uuid: "2ea8ae17c8ce4c78a0729b03287be400" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43353 } }
I20260618 23:19:33.471927 4994 leader_election.cc:288] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1281ab608ad44078a08b34db69e23d34 (127.3.217.130:41867), 82d6251d04d84b5e82cb836e31f1a762 (127.3.217.131:46679)
I20260618 23:19:33.475806 4998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:33.472188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:46679 (local address 127.3.217.129:57225)
0618 23:19:33.472393 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:33.472407 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:33.472479 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:33.472728 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:33.472730 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:33.472735 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:33.472849 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:33.472857 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.473631 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.473632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:33.474509 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:33.474511 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.475558 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.475559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:33.475645 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:33.475649 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:19:33.475702 (+ 53us) client_negotiation.cc:240] Negotiation successful
0618 23:19:33.475736 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":81,"threads_started":1}
I20260618 23:19:33.475827 4986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:33.472444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:57225 (local address 127.3.217.131:46679)
0618 23:19:33.472500 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:33.472502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:33.472510 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:19:33.472543 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:33.472544 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:33.472558 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:33.472609 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:33.473007 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.473528 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.474800 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.475479 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.475553 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:33.475559 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:33.475726 (+ 167us) server_negotiation.cc:299] Negotiation successful
0618 23:19:33.475765 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260618 23:19:33.475826 4987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:33.472356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:55567 (local address 127.3.217.130:41867)
0618 23:19:33.472404 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:33.472406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:33.472421 (+ 15us) server_negotiation.cc:407] Connection header received
0618 23:19:33.472659 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:33.472660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:33.472669 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:33.472749 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:33.472971 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.473502 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.474646 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.475380 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.475466 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:33.475476 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:33.475703 (+ 227us) server_negotiation.cc:299] Negotiation successful
0618 23:19:33.475747 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260618 23:19:33.475956 4997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:33.472188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:41867 (local address 127.3.217.129:55567)
0618 23:19:33.472361 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:33.472374 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:33.472437 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:33.472758 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:33.472759 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:33.472763 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:33.472881 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:33.472884 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.473599 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.473600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:33.474538 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:33.474540 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.475481 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.475482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:33.475590 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:33.475595 (+ 5us) client_negotiation.cc:769] Sending connection context
0618 23:19:33.475666 (+ 71us) client_negotiation.cc:240] Negotiation successful
0618 23:19:33.475716 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":28,"thread_start_us":82,"threads_started":1}
I20260618 23:19:33.476459 4925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85aaaf1ca5ea43cd96e939932c090cab" candidate_uuid: "2ea8ae17c8ce4c78a0729b03287be400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d6251d04d84b5e82cb836e31f1a762" is_pre_election: true
I20260618 23:19:33.476588 4925 raft_consensus.cc:2454] T 85aaaf1ca5ea43cd96e939932c090cab P 82d6251d04d84b5e82cb836e31f1a762 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ea8ae17c8ce4c78a0729b03287be400 in term 0.
I20260618 23:19:33.476926 4591 leader_election.cc:302] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ea8ae17c8ce4c78a0729b03287be400, 82d6251d04d84b5e82cb836e31f1a762; no voters:
I20260618 23:19:33.476981 4791 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85aaaf1ca5ea43cd96e939932c090cab" candidate_uuid: "2ea8ae17c8ce4c78a0729b03287be400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1281ab608ad44078a08b34db69e23d34" is_pre_election: true
I20260618 23:19:33.477109 4791 raft_consensus.cc:2454] T 85aaaf1ca5ea43cd96e939932c090cab P 1281ab608ad44078a08b34db69e23d34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ea8ae17c8ce4c78a0729b03287be400 in term 0.
I20260618 23:19:33.477098 4994 raft_consensus.cc:2781] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:19:33.477164 4994 raft_consensus.cc:482] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:19:33.477198 4994 raft_consensus.cc:3037] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:33.478050 4994 raft_consensus.cc:504] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1281ab608ad44078a08b34db69e23d34" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41867 } } peers { permanent_uuid: "82d6251d04d84b5e82cb836e31f1a762" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46679 } } peers { permanent_uuid: "2ea8ae17c8ce4c78a0729b03287be400" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43353 } }
I20260618 23:19:33.478183 4994 leader_election.cc:288] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400 [CANDIDATE]: Term 1 election: Requested vote from peers 1281ab608ad44078a08b34db69e23d34 (127.3.217.130:41867), 82d6251d04d84b5e82cb836e31f1a762 (127.3.217.131:46679)
I20260618 23:19:33.478374 4925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85aaaf1ca5ea43cd96e939932c090cab" candidate_uuid: "2ea8ae17c8ce4c78a0729b03287be400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d6251d04d84b5e82cb836e31f1a762"
I20260618 23:19:33.478446 4925 raft_consensus.cc:3037] T 85aaaf1ca5ea43cd96e939932c090cab P 82d6251d04d84b5e82cb836e31f1a762 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:33.478386 4791 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85aaaf1ca5ea43cd96e939932c090cab" candidate_uuid: "2ea8ae17c8ce4c78a0729b03287be400" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1281ab608ad44078a08b34db69e23d34"
I20260618 23:19:33.478554 4791 raft_consensus.cc:3037] T 85aaaf1ca5ea43cd96e939932c090cab P 1281ab608ad44078a08b34db69e23d34 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:33.479175 4925 raft_consensus.cc:2454] T 85aaaf1ca5ea43cd96e939932c090cab P 82d6251d04d84b5e82cb836e31f1a762 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ea8ae17c8ce4c78a0729b03287be400 in term 1.
I20260618 23:19:33.479352 4591 leader_election.cc:302] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ea8ae17c8ce4c78a0729b03287be400, 82d6251d04d84b5e82cb836e31f1a762; no voters:
I20260618 23:19:33.479451 4994 raft_consensus.cc:2781] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:33.479480 4791 raft_consensus.cc:2454] T 85aaaf1ca5ea43cd96e939932c090cab P 1281ab608ad44078a08b34db69e23d34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ea8ae17c8ce4c78a0729b03287be400 in term 1.
I20260618 23:19:33.479628 4994 raft_consensus.cc:686] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400 [term 1 LEADER]: Becoming Leader. State: Replica: 2ea8ae17c8ce4c78a0729b03287be400, State: Running, Role: LEADER
I20260618 23:19:33.479725 4994 consensus_queue.cc:237] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1281ab608ad44078a08b34db69e23d34" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41867 } } peers { permanent_uuid: "82d6251d04d84b5e82cb836e31f1a762" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46679 } } peers { permanent_uuid: "2ea8ae17c8ce4c78a0729b03287be400" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43353 } }
I20260618 23:19:33.480867 4512 catalog_manager.cc:5495] T 85aaaf1ca5ea43cd96e939932c090cab P 2ea8ae17c8ce4c78a0729b03287be400 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ea8ae17c8ce4c78a0729b03287be400 (127.3.217.129). New cstate: current_term: 1 leader_uuid: "2ea8ae17c8ce4c78a0729b03287be400" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1281ab608ad44078a08b34db69e23d34" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d6251d04d84b5e82cb836e31f1a762" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ea8ae17c8ce4c78a0729b03287be400" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43353 } health_report { overall_health: HEALTHY } } }
Jun 18 23:19:33 dist-test-slave-r9ct krb5kdc[4467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824772, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.129@KRBTEST.COM
I20260618 23:19:33.494365 4985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:33.485834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47626 (local address 127.3.217.129:43353)
0618 23:19:33.485912 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:33.485914 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:33.486096 (+ 182us) server_negotiation.cc:407] Connection header received
0618 23:19:33.486163 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:33.486164 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:33.486175 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:33.486250 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:33.487069 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.487530 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.488248 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.488437 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.488526 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:33.491116 (+ 2590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:33.491125 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:33.491125 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:33.491135 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:33.492978 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:33.493509 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:33.493513 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:33.493513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:33.493577 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:33.493791 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:33.493799 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:33.493800 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:33.493953 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:33.494125 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:33.494171 (+ 46us) server_negotiation.cc:299] Negotiation successful
0618 23:19:33.494256 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
Jun 18 23:19:33 dist-test-slave-r9ct krb5kdc[4467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824773, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260618 23:19:33.513113 4972 tablet.cc:2369] T 85aaaf1ca5ea43cd96e939932c090cab P 82d6251d04d84b5e82cb836e31f1a762: Can't schedule compaction. Clean time has not been advanced past its initial value.
Jun 18 23:19:33 dist-test-slave-r9ct krb5kdc[4467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824773, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.3.217.129@KRBTEST.COM
I20260618 23:19:33.522403 4985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:33.513378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47638 (local address 127.3.217.129:43353)
0618 23:19:33.513445 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:33.513448 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:33.513710 (+ 262us) server_negotiation.cc:407] Connection header received
0618 23:19:33.513827 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:33.513828 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:33.513844 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:33.513912 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:33.514724 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.515279 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.516166 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.516350 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.516415 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:33.519189 (+ 2774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:33.519191 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:33.519191 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:33.519198 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:33.520797 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:33.521411 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:33.521412 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:33.521413 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:33.521466 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:33.521905 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:33.521906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:33.521906 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:33.522009 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:33.522108 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:33.522274 (+ 166us) server_negotiation.cc:299] Negotiation successful
0618 23:19:33.522337 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
Jun 18 23:19:33 dist-test-slave-r9ct krb5kdc[4467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824773, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 18 23:19:33 dist-test-slave-r9ct krb5kdc[4467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824773, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.129@KRBTEST.COM
I20260618 23:19:33.549355 4985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:33.540625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47644 (local address 127.3.217.129:43353)
0618 23:19:33.540752 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:33.540754 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:33.541146 (+ 392us) server_negotiation.cc:407] Connection header received
0618 23:19:33.541173 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:33.541174 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:33.541184 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:33.541242 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:33.541876 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.542363 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.543198 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:33.543403 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:33.543462 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:33.546033 (+ 2571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:33.546034 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:33.546034 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:33.546041 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:33.547539 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:33.548322 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:33.548323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:33.548323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:33.548379 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:33.548732 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:33.548733 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:33.548733 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:33.548890 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:33.548997 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:33.549144 (+ 147us) server_negotiation.cc:299] Negotiation successful
0618 23:19:33.549209 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
W20260618 23:19:33.549983 4617 tablet_service.cc:2908] Rejecting scan request for tablet 85aaaf1ca5ea43cd96e939932c090cab: Uninitialized: clean time has not yet been initialized
I20260618 23:19:33.551074 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 4574
I20260618 23:19:33.556274 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 4708
I20260618 23:19:33.560724 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 4842
I20260618 23:19:33.565428 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 4480
2026-06-18T23:19:33Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2230 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:19:33 dist-test-slave-r9ct krb5kdc[5013](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:19:33 dist-test-slave-r9ct krb5kdc[5013](info): set up 2 sockets
Jun 18 23:19:33 dist-test-slave-r9ct krb5kdc[5013](info): commencing operation
krb5kdc: starting...
W20260618 23:19:34.646286 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:19:34 dist-test-slave-r9ct krb5kdc[5013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824774, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:19:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:19:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:19:34.778575 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:41419
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:41419
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:34.864040 5026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:34.864310 5026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:34.864351 5026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:34.865496 5026 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:19:34.865571 5026 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260618 23:19:34.865595 5026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:34.865625 5026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:34.865684 5026 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:19:34.865712 5026 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:19:34.867435 5026 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:41419
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:41419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:34.867734 5026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:34.867985 5026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:34.873464 5034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:34.873463 5031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:34.873688 5032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:34.873610 5026 server_base.cc:1034] running on GCE node
I20260618 23:19:34.874059 5026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:34.874382 5026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:34.875564 5026 hybrid_clock.cc:648] HybridClock initialized: now 1781824774875530 us; error 32 us; skew 500 ppm
Jun 18 23:19:34 dist-test-slave-r9ct krb5kdc[5013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824774, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:34.884866 5026 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:19:34.885269 5026 webserver.cc:460] Webserver started at http://127.3.217.190:36025/ using document root <none> and password file <none>
I20260618 23:19:34.885537 5026 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:34.885584 5026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:34.885733 5026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:34.886863 5026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "8d48ff01cff1425cbedeba8c17d0b86c"
format_stamp: "Formatted at 2026-06-18 23:19:34 on dist-test-slave-r9ct"
server_key: "e7177976d894b8f87f9cea5c0a207d22"
server_key_iv: "c2ffd479a596a42d3313e205d3b03980"
server_key_version: "encryptionkey@0"
I20260618 23:19:34.887223 5026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "8d48ff01cff1425cbedeba8c17d0b86c"
format_stamp: "Formatted at 2026-06-18 23:19:34 on dist-test-slave-r9ct"
server_key: "e7177976d894b8f87f9cea5c0a207d22"
server_key_iv: "c2ffd479a596a42d3313e205d3b03980"
server_key_version: "encryptionkey@0"
I20260618 23:19:34.888633 5026 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260618 23:19:34.889500 5041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:34.889878 5026 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:34.889976 5026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "8d48ff01cff1425cbedeba8c17d0b86c"
format_stamp: "Formatted at 2026-06-18 23:19:34 on dist-test-slave-r9ct"
server_key: "e7177976d894b8f87f9cea5c0a207d22"
server_key_iv: "c2ffd479a596a42d3313e205d3b03980"
server_key_version: "encryptionkey@0"
I20260618 23:19:34.890025 5026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:34.902159 5026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:34.904728 5026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:34.904868 5026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:34.909574 5026 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:41419
I20260618 23:19:34.909662 5103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:41419 every 8 connection(s)
I20260618 23:19:34.910041 5026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:19:34.910800 5104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:34.913105 5104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c: Bootstrap starting.
I20260618 23:19:34.913619 5104 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:34.913923 5104 log.cc:824] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:34.914040 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 5026
I20260618 23:19:34.914176 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:19:34.914381 3942 external_mini_cluster.cc:1428] Setting key cd3d535cf2be92d255b6c076200a5708
I20260618 23:19:34.914682 5104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c: No bootstrap required, opened a new log
I20260618 23:19:34.916867 5104 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d48ff01cff1425cbedeba8c17d0b86c" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41419 } }
I20260618 23:19:34.917029 5104 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:34.917074 5104 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d48ff01cff1425cbedeba8c17d0b86c, State: Initialized, Role: FOLLOWER
I20260618 23:19:34.917197 5104 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d48ff01cff1425cbedeba8c17d0b86c" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41419 } }
I20260618 23:19:34.917299 5104 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:19:34.917342 5104 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:19:34.917404 5104 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:34.917939 5104 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d48ff01cff1425cbedeba8c17d0b86c" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41419 } }
I20260618 23:19:34.918061 5104 leader_election.cc:302] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d48ff01cff1425cbedeba8c17d0b86c; no voters:
I20260618 23:19:34.918244 5104 leader_election.cc:288] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:19:34.918275 5109 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:34.918381 5109 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c [term 1 LEADER]: Becoming Leader. State: Replica: 8d48ff01cff1425cbedeba8c17d0b86c, State: Running, Role: LEADER
I20260618 23:19:34.918469 5109 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d48ff01cff1425cbedeba8c17d0b86c" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41419 } }
I20260618 23:19:34.918503 5104 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:19:34.918830 5111 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d48ff01cff1425cbedeba8c17d0b86c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d48ff01cff1425cbedeba8c17d0b86c" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41419 } } }
I20260618 23:19:34.918835 5110 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d48ff01cff1425cbedeba8c17d0b86c. Latest consensus state: current_term: 1 leader_uuid: "8d48ff01cff1425cbedeba8c17d0b86c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d48ff01cff1425cbedeba8c17d0b86c" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41419 } } }
I20260618 23:19:34.919018 5111 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:34.919037 5110 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:34.919332 5118 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:19:34.919822 5118 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:19:34.921927 5118 catalog_manager.cc:1347] Generated new cluster ID: 54bfc1cdfe904a4a8c25568e30da065c
I20260618 23:19:34.921981 5118 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 18 23:19:34 dist-test-slave-r9ct krb5kdc[5013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824774, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:34.927094 5108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:34.914907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38068 (local address 127.3.217.190:41419)
0618 23:19:34.915096 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:34.915103 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:34.915126 (+ 23us) server_negotiation.cc:407] Connection header received
0618 23:19:34.916897 (+ 1771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:34.916903 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:34.916953 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:34.917103 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:34.917848 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:34.919230 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:34.920249 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:34.920864 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:34.920968 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:34.923518 (+ 2550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:34.923521 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:34.923522 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:34.923535 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:34.925428 (+ 1893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:34.925910 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:34.925913 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:34.925913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:34.926024 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:34.926242 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:34.926243 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:34.926243 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:34.926492 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:34.926691 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:34.926799 (+ 108us) server_negotiation.cc:299] Negotiation successful
0618 23:19:34.926953 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":79,"threads_started":1}
I20260618 23:19:34.937139 5118 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:19:34.937893 5118 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:19:34.941424 5118 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c: Generated new TSK 0
I20260618 23:19:34.941668 5118 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.217.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
I20260618 23:19:34.970352 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:41419
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:35.067353 5130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:35.067579 5130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:35.067610 5130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:35.069306 5130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:35.069363 5130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:35.069386 5130 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260618 23:19:35.069404 5130 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:19:35.071376 5130 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.217.190:41419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5130
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:35.071771 5130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:35.072082 5130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:35.078823 5136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:35.078799 5135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:35.078783 5138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:35.079005 5130 server_base.cc:1034] running on GCE node
I20260618 23:19:35.079246 5130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:35.079506 5130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:35.080686 5130 hybrid_clock.cc:648] HybridClock initialized: now 1781824775080665 us; error 36 us; skew 500 ppm
Jun 18 23:19:35 dist-test-slave-r9ct krb5kdc[5013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824775, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:35.083395 5130 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:19:35.083801 5130 webserver.cc:460] Webserver started at http://127.3.217.129:32853/ using document root <none> and password file <none>
I20260618 23:19:35.084039 5130 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:35.084085 5130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:35.084235 5130 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:35.085330 5130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "978fe91bc3da40d794e285bf427be36a"
format_stamp: "Formatted at 2026-06-18 23:19:35 on dist-test-slave-r9ct"
server_key: "c071b75e4b7e8fe97ff4caa1adf343aa"
server_key_iv: "6a7d53e8fb27d0eb5fef90cd0a18dd06"
server_key_version: "encryptionkey@0"
I20260618 23:19:35.085738 5130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "978fe91bc3da40d794e285bf427be36a"
format_stamp: "Formatted at 2026-06-18 23:19:35 on dist-test-slave-r9ct"
server_key: "c071b75e4b7e8fe97ff4caa1adf343aa"
server_key_iv: "6a7d53e8fb27d0eb5fef90cd0a18dd06"
server_key_version: "encryptionkey@0"
I20260618 23:19:35.087165 5130 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260618 23:19:35.088021 5145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:35.088263 5130 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:19:35.088395 5130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "978fe91bc3da40d794e285bf427be36a"
format_stamp: "Formatted at 2026-06-18 23:19:35 on dist-test-slave-r9ct"
server_key: "c071b75e4b7e8fe97ff4caa1adf343aa"
server_key_iv: "6a7d53e8fb27d0eb5fef90cd0a18dd06"
server_key_version: "encryptionkey@0"
I20260618 23:19:35.088465 5130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:35.099963 5130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:35.102180 5130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:35.102298 5130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:35.103014 5130 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:35.103055 5130 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:35.103078 5130 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:35.103091 5130 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 18 23:19:35 dist-test-slave-r9ct krb5kdc[5013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824775, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:35.111583 5130 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:42727
I20260618 23:19:35.111756 5260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:42727 every 8 connection(s)
I20260618 23:19:35.112167 5130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:19:35.114517 5108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.103582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:48327 (local address 127.3.217.190:41419)
0618 23:19:35.103631 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:35.103633 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:35.103776 (+ 143us) server_negotiation.cc:407] Connection header received
0618 23:19:35.104294 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:35.104296 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:35.104310 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:35.104368 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:35.105235 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.106242 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.107412 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.107637 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.107728 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.110954 (+ 3226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:35.110956 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:35.110956 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:35.110964 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:35.113040 (+ 2076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:35.113534 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:35.113535 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:35.113535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:35.113596 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:35.113861 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:35.113862 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:35.113862 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:35.113984 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:35.114060 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:35.114330 (+ 270us) server_negotiation.cc:299] Negotiation successful
0618 23:19:35.114428 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260618 23:19:35.114691 5154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.103399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:41419 (local address 127.3.217.129:48327)
0618 23:19:35.103640 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:35.103689 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:35.104186 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:35.104437 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:35.104440 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:35.104836 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:35.105123 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:35.105128 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.106349 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.106350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:35.107302 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:35.107304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.107750 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.107751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:35.107862 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.108326 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:35.108333 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:35.110802 (+ 2469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:35.113155 (+ 2353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:35.113172 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:35.113175 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:35.113427 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:35.113670 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:35.113671 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:35.113672 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:35.113790 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:35.114052 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:35.114058 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:35.114194 (+ 136us) client_negotiation.cc:769] Sending connection context
0618 23:19:35.114308 (+ 114us) client_negotiation.cc:240] Negotiation successful
0618 23:19:35.114460 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":90,"threads_started":1}
I20260618 23:19:35.115408 5261 heartbeater.cc:347] Connected to a master server at 127.3.217.190:41419
I20260618 23:19:35.115494 5261 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:35.115697 5261 heartbeater.cc:511] Master 127.3.217.190:41419 requested a full tablet report, sending...
I20260618 23:19:35.116191 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 5130
I20260618 23:19:35.116286 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:19:35.116334 5058 ts_manager.cc:194] Registered new tserver with Master: 978fe91bc3da40d794e285bf427be36a (127.3.217.129:42727)
I20260618 23:19:35.116490 3942 external_mini_cluster.cc:1428] Setting key ea5b9d746154a5c355dee08b87d96980
I20260618 23:19:35.117116 5058 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:48327
I20260618 23:19:35.123718 5108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.116614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:33039 (local address 127.3.217.190:41419)
0618 23:19:35.116673 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:35.116675 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:35.117427 (+ 752us) server_negotiation.cc:407] Connection header received
0618 23:19:35.117490 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:35.117491 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:35.117502 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:35.117552 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:35.117910 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.118673 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.119593 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.119823 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.119906 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.120807 (+ 901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:35.120815 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:35.120816 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:35.120822 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:35.122471 (+ 1649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:35.122921 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:35.122922 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:35.122922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:35.122979 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:35.123189 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:35.123189 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:35.123190 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:35.123307 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:35.123388 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:35.123555 (+ 167us) server_negotiation.cc:299] Negotiation successful
0618 23:19:35.123631 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260618 23:19:35.123724 5267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.116660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:41419 (local address 127.3.217.129:33039)
0618 23:19:35.117336 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:35.117367 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:35.117438 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:35.117568 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:35.117568 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:35.117764 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:35.117827 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:35.117829 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.118800 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.118801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:35.119493 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:35.119495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.119907 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.119908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:35.119982 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.120449 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:35.120453 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:35.120710 (+ 257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:35.122589 (+ 1879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:35.122589 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:35.122590 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:35.122848 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:35.123053 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:35.123054 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:35.123054 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:35.123112 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:35.123380 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:35.123381 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:35.123427 (+ 46us) client_negotiation.cc:769] Sending connection context
0618 23:19:35.123528 (+ 101us) client_negotiation.cc:240] Negotiation successful
0618 23:19:35.123631 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":158,"threads_started":1}
WARNING: no policy specified for kudu/127.3.217.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
I20260618 23:19:35.142073 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:41419
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:35.222182 5270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:35.222393 5270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:35.222417 5270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:35.223491 5270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:35.223524 5270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:35.223544 5270 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260618 23:19:35.223560 5270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:19:35.224864 5270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.217.190:41419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:35.225034 5270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:35.225196 5270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260618 23:19:35.230444 5270 server_base.cc:1034] running on GCE node
W20260618 23:19:35.230438 5278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:35.230417 5276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:35.230571 5275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:35.230811 5270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:35.231014 5270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:35.232163 5270 hybrid_clock.cc:648] HybridClock initialized: now 1781824775232154 us; error 31 us; skew 500 ppm
Jun 18 23:19:35 dist-test-slave-r9ct krb5kdc[5013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824775, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:35.234865 5270 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:19:35.235402 5270 webserver.cc:460] Webserver started at http://127.3.217.130:45445/ using document root <none> and password file <none>
I20260618 23:19:35.235649 5270 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:35.235724 5270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:35.235916 5270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:35.237062 5270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "33b23bde919041e6b0e9010140e79b63"
format_stamp: "Formatted at 2026-06-18 23:19:35 on dist-test-slave-r9ct"
server_key: "9b5d11bd7e37096ae17d04c0874c2319"
server_key_iv: "c057d564f85001fd977b939b0e557f29"
server_key_version: "encryptionkey@0"
I20260618 23:19:35.237453 5270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "33b23bde919041e6b0e9010140e79b63"
format_stamp: "Formatted at 2026-06-18 23:19:35 on dist-test-slave-r9ct"
server_key: "9b5d11bd7e37096ae17d04c0874c2319"
server_key_iv: "c057d564f85001fd977b939b0e557f29"
server_key_version: "encryptionkey@0"
I20260618 23:19:35.238953 5270 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:19:35.239907 5285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:35.240175 5270 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:35.240293 5270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "33b23bde919041e6b0e9010140e79b63"
format_stamp: "Formatted at 2026-06-18 23:19:35 on dist-test-slave-r9ct"
server_key: "9b5d11bd7e37096ae17d04c0874c2319"
server_key_iv: "c057d564f85001fd977b939b0e557f29"
server_key_version: "encryptionkey@0"
I20260618 23:19:35.240389 5270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:35.258934 5270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:35.261958 5270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:35.262135 5270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:35.262918 5270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:35.262984 5270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:35.263221 5270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:35.263316 5270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 18 23:19:35 dist-test-slave-r9ct krb5kdc[5013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824775, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:35.271664 5270 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:39027
I20260618 23:19:35.271708 5400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:39027 every 8 connection(s)
I20260618 23:19:35.272084 5270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:19:35.274092 5108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.263382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:34701 (local address 127.3.217.190:41419)
0618 23:19:35.263449 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:35.263452 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:35.263637 (+ 185us) server_negotiation.cc:407] Connection header received
0618 23:19:35.264184 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:35.264186 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:35.264207 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:35.264324 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:35.264929 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.265971 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.267203 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.267562 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.267652 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.270295 (+ 2643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:35.270297 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:35.270297 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:35.270308 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:35.272340 (+ 2032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:35.272851 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:35.272852 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:35.272852 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:35.272911 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:35.273371 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:35.273371 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:35.273372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:35.273555 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:35.273649 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:35.273944 (+ 295us) server_negotiation.cc:299] Negotiation successful
0618 23:19:35.274023 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260618 23:19:35.274259 5293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.263327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:41419 (local address 127.3.217.130:34701)
0618 23:19:35.263483 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:35.263523 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:35.264050 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:35.264391 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:35.264394 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:35.264620 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:35.264812 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:35.264816 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.266099 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.266100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:35.267126 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:35.267129 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.267660 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.267660 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:35.267813 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.268325 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:35.268333 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:35.270163 (+ 1830us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:35.272443 (+ 2280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:35.272448 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:35.272450 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:35.272718 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:35.273038 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:35.273040 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:35.273040 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:35.273225 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:35.273674 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:35.273680 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:35.273796 (+ 116us) client_negotiation.cc:769] Sending connection context
0618 23:19:35.273915 (+ 119us) client_negotiation.cc:240] Negotiation successful
0618 23:19:35.274035 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
I20260618 23:19:35.274974 5401 heartbeater.cc:347] Connected to a master server at 127.3.217.190:41419
I20260618 23:19:35.275075 5401 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:35.275245 5401 heartbeater.cc:511] Master 127.3.217.190:41419 requested a full tablet report, sending...
I20260618 23:19:35.275650 5057 ts_manager.cc:194] Registered new tserver with Master: 33b23bde919041e6b0e9010140e79b63 (127.3.217.130:39027)
I20260618 23:19:35.276046 5057 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:34701
I20260618 23:19:35.276901 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 5270
I20260618 23:19:35.277001 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:19:35.277179 3942 external_mini_cluster.cc:1428] Setting key b1773b97541d2340cb572eeaad660933
I20260618 23:19:35.283293 5108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.276929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:47755 (local address 127.3.217.190:41419)
0618 23:19:35.277137 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:35.277139 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:35.277148 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:19:35.277168 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:35.277169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:35.277179 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:35.277291 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:35.277643 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.278199 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.278974 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.279178 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.279264 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.280211 (+ 947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:35.280212 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:35.280212 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:35.280218 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:35.282032 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:35.282445 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:35.282446 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:35.282446 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:35.282500 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:35.282738 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:35.282739 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:35.282739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:35.282892 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:35.282976 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:35.283132 (+ 156us) server_negotiation.cc:299] Negotiation successful
0618 23:19:35.283205 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184}
I20260618 23:19:35.283339 5407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.276317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:41419 (local address 127.3.217.130:47755)
0618 23:19:35.276467 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:35.276477 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:35.276528 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:35.277301 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:35.277302 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:35.277502 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:35.277553 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:35.277554 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.278296 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.278297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:35.278882 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:35.278884 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.279263 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.279264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:35.279335 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.279818 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:35.279823 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:35.280103 (+ 280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:35.282170 (+ 2067us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:35.282171 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:35.282172 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:35.282352 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:35.282581 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:35.282581 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:35.282582 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:35.282640 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:35.282968 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:35.282968 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:35.283013 (+ 45us) client_negotiation.cc:769] Sending connection context
0618 23:19:35.283107 (+ 94us) client_negotiation.cc:240] Negotiation successful
0618 23:19:35.283238 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":82,"threads_started":1}
WARNING: no policy specified for kudu/127.3.217.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
I20260618 23:19:35.306826 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:41419
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:35.395809 5410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:35.396091 5410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:35.396148 5410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:35.397804 5410 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:35.397878 5410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:35.397917 5410 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260618 23:19:35.397969 5410 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:19:35.399747 5410 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.217.190:41419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5410
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:35.400050 5410 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:35.400321 5410 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:35.406210 5415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:35.406213 5416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:35.406271 5418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:35.406492 5410 server_base.cc:1034] running on GCE node
I20260618 23:19:35.406834 5410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:35.407128 5410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:35.408368 5410 hybrid_clock.cc:648] HybridClock initialized: now 1781824775408342 us; error 59 us; skew 500 ppm
Jun 18 23:19:35 dist-test-slave-r9ct krb5kdc[5013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824775, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:35.411942 5410 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:19:35.412499 5410 webserver.cc:460] Webserver started at http://127.3.217.131:33401/ using document root <none> and password file <none>
I20260618 23:19:35.412767 5410 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:35.412848 5410 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:35.413014 5410 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:35.414175 5410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "71187c1517aa495e9233bf975b223384"
format_stamp: "Formatted at 2026-06-18 23:19:35 on dist-test-slave-r9ct"
server_key: "58ebc31e6cd96af99526203ce538407c"
server_key_iv: "5b9609d3ec98c4a863113d8011081253"
server_key_version: "encryptionkey@0"
I20260618 23:19:35.414646 5410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "71187c1517aa495e9233bf975b223384"
format_stamp: "Formatted at 2026-06-18 23:19:35 on dist-test-slave-r9ct"
server_key: "58ebc31e6cd96af99526203ce538407c"
server_key_iv: "5b9609d3ec98c4a863113d8011081253"
server_key_version: "encryptionkey@0"
I20260618 23:19:35.416301 5410 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:35.417361 5425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:35.417757 5410 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:35.418011 5410 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "71187c1517aa495e9233bf975b223384"
format_stamp: "Formatted at 2026-06-18 23:19:35 on dist-test-slave-r9ct"
server_key: "58ebc31e6cd96af99526203ce538407c"
server_key_iv: "5b9609d3ec98c4a863113d8011081253"
server_key_version: "encryptionkey@0"
I20260618 23:19:35.418151 5410 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:35.428954 5410 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:35.432197 5410 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:35.432471 5410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:35.432991 5410 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:35.433058 5410 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:35.433104 5410 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:35.433130 5410 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 18 23:19:35 dist-test-slave-r9ct krb5kdc[5013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824775, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:35.442137 5410 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:33933
I20260618 23:19:35.442524 5540 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:33933 every 8 connection(s)
I20260618 23:19:35.442678 5410 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:19:35.445536 5108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.433528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:53543 (local address 127.3.217.190:41419)
0618 23:19:35.433602 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:35.433605 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:35.433786 (+ 181us) server_negotiation.cc:407] Connection header received
0618 23:19:35.434301 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:35.434302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:35.434316 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:35.434437 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:35.435531 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.436516 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.438132 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.438505 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.438610 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.441917 (+ 3307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:35.441918 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:35.441919 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:35.441926 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:35.443664 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:35.444241 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:35.444242 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:35.444243 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:35.444328 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:35.444611 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:35.444612 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:35.444613 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:35.444734 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:35.444808 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:35.445382 (+ 574us) server_negotiation.cc:299] Negotiation successful
0618 23:19:35.445472 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260618 23:19:35.445765 5434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.433495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:41419 (local address 127.3.217.131:53543)
0618 23:19:35.433651 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:35.433690 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:35.434180 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:35.434531 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:35.434536 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:35.434978 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:35.435363 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:35.435372 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.436656 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.436658 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:35.438006 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:35.438008 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.438637 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.438638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:35.438807 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.439461 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:35.439474 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:35.441681 (+ 2207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:35.443807 (+ 2126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:35.443813 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:35.443815 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:35.444107 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:35.444404 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:35.444404 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:35.444404 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:35.444501 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:35.444883 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:35.444890 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:35.445199 (+ 309us) client_negotiation.cc:769] Sending connection context
0618 23:19:35.445317 (+ 118us) client_negotiation.cc:240] Negotiation successful
0618 23:19:35.445475 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":93,"threads_started":1}
I20260618 23:19:35.446434 5541 heartbeater.cc:347] Connected to a master server at 127.3.217.190:41419
I20260618 23:19:35.446529 5541 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:35.446765 5541 heartbeater.cc:511] Master 127.3.217.190:41419 requested a full tablet report, sending...
I20260618 23:19:35.447360 5058 ts_manager.cc:194] Registered new tserver with Master: 71187c1517aa495e9233bf975b223384 (127.3.217.131:33933)
I20260618 23:19:35.447798 5058 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:53543
I20260618 23:19:35.452354 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 5410
I20260618 23:19:35.452452 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:19:35.452642 3942 external_mini_cluster.cc:1428] Setting key 72c1e93446f340d3bf0c0a16cf126a56
I20260618 23:19:35.454180 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260618 23:19:35.454809 5547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.448102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:41419 (local address 127.3.217.131:44219)
0618 23:19:35.448283 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:35.448300 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:35.448388 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:35.448521 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:35.448522 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:35.448720 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:35.448777 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:35.448778 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.449431 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.449431 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:35.449965 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:35.449967 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.450355 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.450356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:35.450437 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.450938 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:35.450942 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:35.451210 (+ 268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:35.453591 (+ 2381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:35.453592 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:35.453593 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:35.453822 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:35.454025 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:35.454026 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:35.454026 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:35.454097 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:35.454397 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:35.454398 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:35.454455 (+ 57us) client_negotiation.cc:769] Sending connection context
0618 23:19:35.454540 (+ 85us) client_negotiation.cc:240] Negotiation successful
0618 23:19:35.454661 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":100,"threads_started":1}
I20260618 23:19:35.454999 5108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.448158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:44219 (local address 127.3.217.190:41419)
0618 23:19:35.448196 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:35.448197 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:35.448370 (+ 173us) server_negotiation.cc:407] Connection header received
0618 23:19:35.448446 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:35.448447 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:35.448456 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:35.448512 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:35.448859 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.449333 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.450066 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.450267 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.450354 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.451335 (+ 981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:35.451336 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:35.451337 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:35.451344 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:35.453506 (+ 2162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:35.453897 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:35.453898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:35.453899 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:35.453957 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:35.454167 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:35.454168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:35.454169 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:35.454284 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:35.454363 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:35.454668 (+ 305us) server_negotiation.cc:299] Negotiation successful
0618 23:19:35.454811 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
Jun 18 23:19:35 dist-test-slave-r9ct krb5kdc[5013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824775, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 18 23:19:35 dist-test-slave-r9ct krb5kdc[5013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824775, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:35.480922 5108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.472623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38072 (local address 127.3.217.190:41419)
0618 23:19:35.472690 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:35.472692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:35.472699 (+ 7us) server_negotiation.cc:407] Connection header received
0618 23:19:35.472719 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:35.472720 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:35.472728 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:35.472804 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:35.473396 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.473972 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.474733 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.474934 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.475016 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.477686 (+ 2670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:35.477687 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:35.477688 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:35.477694 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:35.479672 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:35.480126 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:35.480127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:35.480127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:35.480185 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:35.480388 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:35.480389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:35.480389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:35.480500 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:35.480610 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:35.480737 (+ 127us) server_negotiation.cc:299] Negotiation successful
0618 23:19:35.480818 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260618 23:19:35.483034 5058 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38072:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:19:35.484649 5058 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:19:35.492354 5558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.487767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:42727 (local address 127.0.0.1:59244)
0618 23:19:35.488051 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:35.488090 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:35.488167 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:35.488446 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:35.488449 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:35.488452 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:35.488528 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:35.488529 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.489792 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.489793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:35.491125 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:35.491128 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.492036 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.492037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:35.492113 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.492126 (+ 13us) client_negotiation.cc:769] Sending connection context
0618 23:19:35.492224 (+ 98us) client_negotiation.cc:240] Negotiation successful
0618 23:19:35.492274 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":75,"threads_started":1}
I20260618 23:19:35.492622 5563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.487771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:33933 (local address 127.0.0.1:53902)
0618 23:19:35.488648 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:35.488658 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:35.488707 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:35.488884 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:35.488885 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:35.488887 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:35.489025 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:35.489027 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.490392 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.490393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:35.491388 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:35.491391 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.492379 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.492380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:35.492459 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.492463 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:19:35.492518 (+ 55us) client_negotiation.cc:240] Negotiation successful
0618 23:19:35.492558 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":857,"mutex_wait_us":23,"spinlock_wait_cycles":768,"thread_start_us":405,"threads_started":1}
I20260618 23:19:35.492712 5559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.487878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59244 (local address 127.3.217.129:42727)
0618 23:19:35.488064 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:35.488069 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:35.488251 (+ 182us) server_negotiation.cc:407] Connection header received
0618 23:19:35.488293 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:35.488295 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:35.488310 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:35.488379 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:35.488607 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.489692 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.491204 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.491929 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.492005 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.492102 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:35.492552 (+ 450us) server_negotiation.cc:299] Negotiation successful
0618 23:19:35.492597 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":87,"threads_started":1}
I20260618 23:19:35.492766 5562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.487770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:39027 (local address 127.0.0.1:47632)
0618 23:19:35.488305 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:35.488315 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:35.488379 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:35.488844 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:35.488844 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:35.488847 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:35.489027 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:35.489034 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.490389 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.490390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:35.491551 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:35.491554 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.492493 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.492494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:35.492605 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.492609 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:19:35.492658 (+ 49us) client_negotiation.cc:240] Negotiation successful
0618 23:19:35.492697 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"mutex_wait_us":3,"thread_start_us":456,"threads_started":1}
I20260618 23:19:35.493046 5561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.487957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47632 (local address 127.3.217.130:39027)
0618 23:19:35.488612 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:35.488615 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:35.488626 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:19:35.488661 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:35.488662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:35.488674 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:35.488779 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:35.489251 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.490290 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.491631 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.492342 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.492405 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.492460 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:35.492907 (+ 447us) server_negotiation.cc:299] Negotiation successful
0618 23:19:35.492947 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":519,"thread_start_us":79,"threads_started":1}
I20260618 23:19:35.493376 5195 tablet_service.cc:1467] Processing CreateTablet for tablet 759b1ad15e764a968f3ab5675b26a38d (DEFAULT_TABLE table=test-table [id=f9c5e9741198458f8af513fd579dca3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:35.493527 5335 tablet_service.cc:1467] Processing CreateTablet for tablet 759b1ad15e764a968f3ab5675b26a38d (DEFAULT_TABLE table=test-table [id=f9c5e9741198458f8af513fd579dca3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:35.493741 5195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 759b1ad15e764a968f3ab5675b26a38d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:35.493868 5335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 759b1ad15e764a968f3ab5675b26a38d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:35.496857 5564 tablet_bootstrap.cc:492] T 759b1ad15e764a968f3ab5675b26a38d P 33b23bde919041e6b0e9010140e79b63: Bootstrap starting.
I20260618 23:19:35.497350 5560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.487952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53902 (local address 127.3.217.131:33933)
0618 23:19:35.488164 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:35.488169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:35.488732 (+ 563us) server_negotiation.cc:407] Connection header received
0618 23:19:35.488774 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:35.488776 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:35.488790 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:35.488867 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:35.489153 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.490290 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.491499 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.492229 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.492293 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.492352 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:35.492774 (+ 422us) server_negotiation.cc:299] Negotiation successful
0618 23:19:35.492819 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":74,"threads_started":1}
I20260618 23:19:35.497368 5565 tablet_bootstrap.cc:492] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a: Bootstrap starting.
I20260618 23:19:35.497548 5564 tablet_bootstrap.cc:654] T 759b1ad15e764a968f3ab5675b26a38d P 33b23bde919041e6b0e9010140e79b63: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:35.497910 5564 log.cc:824] T 759b1ad15e764a968f3ab5675b26a38d P 33b23bde919041e6b0e9010140e79b63: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:35.497979 5565 tablet_bootstrap.cc:654] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:35.498286 5565 log.cc:824] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:35.498217 5475 tablet_service.cc:1467] Processing CreateTablet for tablet 759b1ad15e764a968f3ab5675b26a38d (DEFAULT_TABLE table=test-table [id=f9c5e9741198458f8af513fd579dca3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:35.498631 5475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 759b1ad15e764a968f3ab5675b26a38d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:35.498867 5564 tablet_bootstrap.cc:492] T 759b1ad15e764a968f3ab5675b26a38d P 33b23bde919041e6b0e9010140e79b63: No bootstrap required, opened a new log
I20260618 23:19:35.498939 5564 ts_tablet_manager.cc:1397] T 759b1ad15e764a968f3ab5675b26a38d P 33b23bde919041e6b0e9010140e79b63: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:19:35.498993 5565 tablet_bootstrap.cc:492] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a: No bootstrap required, opened a new log
I20260618 23:19:35.499055 5565 ts_tablet_manager.cc:1397] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:19:35.501497 5568 tablet_bootstrap.cc:492] T 759b1ad15e764a968f3ab5675b26a38d P 71187c1517aa495e9233bf975b223384: Bootstrap starting.
I20260618 23:19:35.501498 5564 raft_consensus.cc:348] T 759b1ad15e764a968f3ab5675b26a38d P 33b23bde919041e6b0e9010140e79b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:35.501543 5565 raft_consensus.cc:348] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:35.501675 5565 raft_consensus.cc:374] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:35.501672 5564 raft_consensus.cc:374] T 759b1ad15e764a968f3ab5675b26a38d P 33b23bde919041e6b0e9010140e79b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:35.501718 5564 raft_consensus.cc:729] T 759b1ad15e764a968f3ab5675b26a38d P 33b23bde919041e6b0e9010140e79b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33b23bde919041e6b0e9010140e79b63, State: Initialized, Role: FOLLOWER
I20260618 23:19:35.501718 5565 raft_consensus.cc:729] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978fe91bc3da40d794e285bf427be36a, State: Initialized, Role: FOLLOWER
I20260618 23:19:35.501838 5564 consensus_queue.cc:260] T 759b1ad15e764a968f3ab5675b26a38d P 33b23bde919041e6b0e9010140e79b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:35.501853 5565 consensus_queue.cc:260] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:35.502101 5564 ts_tablet_manager.cc:1428] T 759b1ad15e764a968f3ab5675b26a38d P 33b23bde919041e6b0e9010140e79b63: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260618 23:19:35.502101 5565 ts_tablet_manager.cc:1428] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260618 23:19:35.502216 5401 heartbeater.cc:503] Master 127.3.217.190:41419 was elected leader, sending a full tablet report...
I20260618 23:19:35.502240 5261 heartbeater.cc:503] Master 127.3.217.190:41419 was elected leader, sending a full tablet report...
I20260618 23:19:35.502853 5568 tablet_bootstrap.cc:654] T 759b1ad15e764a968f3ab5675b26a38d P 71187c1517aa495e9233bf975b223384: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:35.503178 5568 log.cc:824] T 759b1ad15e764a968f3ab5675b26a38d P 71187c1517aa495e9233bf975b223384: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:35.503878 5568 tablet_bootstrap.cc:492] T 759b1ad15e764a968f3ab5675b26a38d P 71187c1517aa495e9233bf975b223384: No bootstrap required, opened a new log
I20260618 23:19:35.504053 5568 ts_tablet_manager.cc:1397] T 759b1ad15e764a968f3ab5675b26a38d P 71187c1517aa495e9233bf975b223384: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260618 23:19:35.505535 5568 raft_consensus.cc:348] T 759b1ad15e764a968f3ab5675b26a38d P 71187c1517aa495e9233bf975b223384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:35.505690 5568 raft_consensus.cc:374] T 759b1ad15e764a968f3ab5675b26a38d P 71187c1517aa495e9233bf975b223384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:35.505738 5568 raft_consensus.cc:729] T 759b1ad15e764a968f3ab5675b26a38d P 71187c1517aa495e9233bf975b223384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71187c1517aa495e9233bf975b223384, State: Initialized, Role: FOLLOWER
I20260618 23:19:35.505863 5568 consensus_queue.cc:260] T 759b1ad15e764a968f3ab5675b26a38d P 71187c1517aa495e9233bf975b223384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:35.506150 5568 ts_tablet_manager.cc:1428] T 759b1ad15e764a968f3ab5675b26a38d P 71187c1517aa495e9233bf975b223384: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260618 23:19:35.506228 5541 heartbeater.cc:503] Master 127.3.217.190:41419 was elected leader, sending a full tablet report...
W20260618 23:19:35.522696 5402 tablet.cc:2369] T 759b1ad15e764a968f3ab5675b26a38d P 33b23bde919041e6b0e9010140e79b63: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260618 23:19:35.613087 5262 tablet.cc:2369] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260618 23:19:35.693426 5542 tablet.cc:2369] T 759b1ad15e764a968f3ab5675b26a38d P 71187c1517aa495e9233bf975b223384: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 23:19:35.789918 5570 raft_consensus.cc:482] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:19:35.790051 5570 raft_consensus.cc:504] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:35.790434 5570 leader_election.cc:288] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33b23bde919041e6b0e9010140e79b63 (127.3.217.130:39027), 71187c1517aa495e9233bf975b223384 (127.3.217.131:33933)
I20260618 23:19:35.794183 5560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.790845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:59087 (local address 127.3.217.131:33933)
0618 23:19:35.791010 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:35.791012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:35.791027 (+ 15us) server_negotiation.cc:407] Connection header received
0618 23:19:35.791058 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:35.791059 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:35.791071 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:35.791176 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:35.791419 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.792192 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.793393 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.793815 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.793902 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.793911 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:35.794053 (+ 142us) server_negotiation.cc:299] Negotiation successful
0618 23:19:35.794119 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260618 23:19:35.794205 5561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.790862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:37633 (local address 127.3.217.130:39027)
0618 23:19:35.790910 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:35.790912 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:35.791141 (+ 229us) server_negotiation.cc:407] Connection header received
0618 23:19:35.791406 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:35.791408 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:35.791420 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:35.791496 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:35.791681 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.792388 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.793454 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.793806 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.793962 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.793972 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:35.794108 (+ 136us) server_negotiation.cc:299] Negotiation successful
0618 23:19:35.794145 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260618 23:19:35.794207 5574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.790806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:39027 (local address 127.3.217.129:37633)
0618 23:19:35.791058 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:35.791067 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:35.791138 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:35.791544 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:35.791545 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:35.791547 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:35.791595 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:35.791596 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.792473 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.792474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:35.793339 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:35.793341 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.793963 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.793964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:35.794033 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.794036 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:19:35.794086 (+ 50us) client_negotiation.cc:240] Negotiation successful
0618 23:19:35.794111 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"mutex_wait_us":3,"thread_start_us":173,"threads_started":1}
I20260618 23:19:35.794215 5573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.790668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:33933 (local address 127.3.217.129:59087)
0618 23:19:35.790886 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:35.790901 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:35.790973 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:35.791188 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:35.791190 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:35.791193 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:35.791303 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:35.791306 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.792313 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.792314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:35.793290 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:35.793292 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.793901 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.793901 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:35.793975 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.793979 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:19:35.794036 (+ 57us) client_negotiation.cc:240] Negotiation successful
0618 23:19:35.794086 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"mutex_wait_us":34,"thread_start_us":121,"threads_started":1}
I20260618 23:19:35.794570 5355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "759b1ad15e764a968f3ab5675b26a38d" candidate_uuid: "978fe91bc3da40d794e285bf427be36a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33b23bde919041e6b0e9010140e79b63" is_pre_election: true
I20260618 23:19:35.794742 5355 raft_consensus.cc:2454] T 759b1ad15e764a968f3ab5675b26a38d P 33b23bde919041e6b0e9010140e79b63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978fe91bc3da40d794e285bf427be36a in term 0.
I20260618 23:19:35.795078 5495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "759b1ad15e764a968f3ab5675b26a38d" candidate_uuid: "978fe91bc3da40d794e285bf427be36a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71187c1517aa495e9233bf975b223384" is_pre_election: true
I20260618 23:19:35.795179 5495 raft_consensus.cc:2454] T 759b1ad15e764a968f3ab5675b26a38d P 71187c1517aa495e9233bf975b223384 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 978fe91bc3da40d794e285bf427be36a in term 0.
I20260618 23:19:35.795202 5147 leader_election.cc:302] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33b23bde919041e6b0e9010140e79b63, 978fe91bc3da40d794e285bf427be36a; no voters:
I20260618 23:19:35.795337 5570 raft_consensus.cc:2781] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:19:35.795405 5570 raft_consensus.cc:482] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:19:35.795439 5570 raft_consensus.cc:3037] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:35.796149 5570 raft_consensus.cc:504] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:35.796316 5570 leader_election.cc:288] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a [CANDIDATE]: Term 1 election: Requested vote from peers 33b23bde919041e6b0e9010140e79b63 (127.3.217.130:39027), 71187c1517aa495e9233bf975b223384 (127.3.217.131:33933)
I20260618 23:19:35.796480 5355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "759b1ad15e764a968f3ab5675b26a38d" candidate_uuid: "978fe91bc3da40d794e285bf427be36a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33b23bde919041e6b0e9010140e79b63"
I20260618 23:19:35.796480 5495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "759b1ad15e764a968f3ab5675b26a38d" candidate_uuid: "978fe91bc3da40d794e285bf427be36a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71187c1517aa495e9233bf975b223384"
I20260618 23:19:35.796567 5495 raft_consensus.cc:3037] T 759b1ad15e764a968f3ab5675b26a38d P 71187c1517aa495e9233bf975b223384 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:35.796562 5355 raft_consensus.cc:3037] T 759b1ad15e764a968f3ab5675b26a38d P 33b23bde919041e6b0e9010140e79b63 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:35.797412 5495 raft_consensus.cc:2454] T 759b1ad15e764a968f3ab5675b26a38d P 71187c1517aa495e9233bf975b223384 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978fe91bc3da40d794e285bf427be36a in term 1.
I20260618 23:19:35.797412 5355 raft_consensus.cc:2454] T 759b1ad15e764a968f3ab5675b26a38d P 33b23bde919041e6b0e9010140e79b63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 978fe91bc3da40d794e285bf427be36a in term 1.
I20260618 23:19:35.797675 5147 leader_election.cc:302] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33b23bde919041e6b0e9010140e79b63, 978fe91bc3da40d794e285bf427be36a; no voters:
I20260618 23:19:35.797780 5570 raft_consensus.cc:2781] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:35.797973 5570 raft_consensus.cc:686] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a [term 1 LEADER]: Becoming Leader. State: Replica: 978fe91bc3da40d794e285bf427be36a, State: Running, Role: LEADER
I20260618 23:19:35.798075 5570 consensus_queue.cc:237] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:35.798866 5057 catalog_manager.cc:5495] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a reported cstate change: term changed from 0 to 1, leader changed from <none> to 978fe91bc3da40d794e285bf427be36a (127.3.217.129). New cstate: current_term: 1 leader_uuid: "978fe91bc3da40d794e285bf427be36a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } health_report { overall_health: UNKNOWN } } }
I20260618 23:19:35.851747 5559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:35.848271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59252 (local address 127.3.217.129:42727)
0618 23:19:35.848436 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:35.848438 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:35.848450 (+ 12us) server_negotiation.cc:407] Connection header received
0618 23:19:35.848512 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:35.848513 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:35.848534 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:35.848618 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:19:35.848881 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.849496 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.850455 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:35.850706 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:35.850809 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:35.851148 (+ 339us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:19:35.851283 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:19:35.851372 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:35.851616 (+ 244us) server_negotiation.cc:299] Negotiation successful
0618 23:19:35.851657 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119}
I20260618 23:19:35.853938 5355 raft_consensus.cc:1261] T 759b1ad15e764a968f3ab5675b26a38d P 33b23bde919041e6b0e9010140e79b63 [term 1 FOLLOWER]: Refusing update from remote peer 978fe91bc3da40d794e285bf427be36a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:19:35.853938 5495 raft_consensus.cc:1261] T 759b1ad15e764a968f3ab5675b26a38d P 71187c1517aa495e9233bf975b223384 [term 1 FOLLOWER]: Refusing update from remote peer 978fe91bc3da40d794e285bf427be36a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:19:35.854292 5570 consensus_queue.cc:1035] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:19:35.854504 5575 consensus_queue.cc:1035] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a [LEADER]: Connected to new peer: Peer: permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:19:35.857331 5579 mvcc.cc:205] Tried to move back new op lower bound from 7298354281894658048 to 7298354281669439488. Current Snapshot: MvccSnapshot[applied={T|T < 7298354281894658048}]
I20260618 23:19:35.859431 5581 mvcc.cc:205] Tried to move back new op lower bound from 7298354281894658048 to 7298354281669439488. Current Snapshot: MvccSnapshot[applied={T|T < 7298354281894658048 or (T in {7298354281894658048})}]
I20260618 23:19:35.860252 5058 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:19:35.860368 5058 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:19:35.861181 5058 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c: Sending DeleteTablet for 3 replicas of tablet 759b1ad15e764a968f3ab5675b26a38d
I20260618 23:19:35.861603 5335 tablet_service.cc:1514] Processing DeleteTablet for tablet 759b1ad15e764a968f3ab5675b26a38d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:35 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:47632
I20260618 23:19:35.861640 5475 tablet_service.cc:1514] Processing DeleteTablet for tablet 759b1ad15e764a968f3ab5675b26a38d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:35 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:53902
I20260618 23:19:35.861761 5195 tablet_service.cc:1514] Processing DeleteTablet for tablet 759b1ad15e764a968f3ab5675b26a38d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:35 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:59244
I20260618 23:19:35.861850 5588 tablet_replica.cc:330] T 759b1ad15e764a968f3ab5675b26a38d P 33b23bde919041e6b0e9010140e79b63: stopping tablet replica
I20260618 23:19:35.861939 5588 raft_consensus.cc:2229] T 759b1ad15e764a968f3ab5675b26a38d P 33b23bde919041e6b0e9010140e79b63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:19:35.862041 5588 raft_consensus.cc:2258] T 759b1ad15e764a968f3ab5675b26a38d P 33b23bde919041e6b0e9010140e79b63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:35.862169 5058 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38072:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:19:35.862325 5058 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:19:35.862409 5589 tablet_replica.cc:330] T 759b1ad15e764a968f3ab5675b26a38d P 71187c1517aa495e9233bf975b223384: stopping tablet replica
I20260618 23:19:35.862507 5589 raft_consensus.cc:2229] T 759b1ad15e764a968f3ab5675b26a38d P 71187c1517aa495e9233bf975b223384 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:19:35.862612 5589 raft_consensus.cc:2258] T 759b1ad15e764a968f3ab5675b26a38d P 71187c1517aa495e9233bf975b223384 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:35.862632 5588 ts_tablet_manager.cc:1905] T 759b1ad15e764a968f3ab5675b26a38d P 33b23bde919041e6b0e9010140e79b63: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:19:35.862785 5590 tablet_replica.cc:330] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a: stopping tablet replica
I20260618 23:19:35.862877 5590 raft_consensus.cc:2229] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:19:35.862967 5590 raft_consensus.cc:2258] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:35.863373 5590 ts_tablet_manager.cc:1905] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:19:35.863883 5335 tablet_service.cc:1467] Processing CreateTablet for tablet 28916c96469e45e18e944e1c00e86d4c (DEFAULT_TABLE table=test-table [id=cb1a1d4ed3dd4f0bb8fc1b5066c2def8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:35.863996 5335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28916c96469e45e18e944e1c00e86d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:35.864809 5588 ts_tablet_manager.cc:1918] T 759b1ad15e764a968f3ab5675b26a38d P 33b23bde919041e6b0e9010140e79b63: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:19:35.865039 5588 log.cc:1196] T 759b1ad15e764a968f3ab5675b26a38d P 33b23bde919041e6b0e9010140e79b63: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/759b1ad15e764a968f3ab5675b26a38d
I20260618 23:19:35.865185 5590 ts_tablet_manager.cc:1918] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:19:35.865306 5590 log.cc:1196] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-0/wal/wals/759b1ad15e764a968f3ab5675b26a38d
I20260618 23:19:35.865432 5564 tablet_bootstrap.cc:492] T 28916c96469e45e18e944e1c00e86d4c P 33b23bde919041e6b0e9010140e79b63: Bootstrap starting.
I20260618 23:19:35.865576 5588 ts_tablet_manager.cc:1939] T 759b1ad15e764a968f3ab5675b26a38d P 33b23bde919041e6b0e9010140e79b63: Deleting consensus metadata
I20260618 23:19:35.865789 5590 ts_tablet_manager.cc:1939] T 759b1ad15e764a968f3ab5675b26a38d P 978fe91bc3da40d794e285bf427be36a: Deleting consensus metadata
I20260618 23:19:35.865885 5564 tablet_bootstrap.cc:654] T 28916c96469e45e18e944e1c00e86d4c P 33b23bde919041e6b0e9010140e79b63: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:35.866384 5043 catalog_manager.cc:4841] TS 33b23bde919041e6b0e9010140e79b63 (127.3.217.130:39027): tablet 759b1ad15e764a968f3ab5675b26a38d (table test-table [id=f9c5e9741198458f8af513fd579dca3a]) successfully deleted
I20260618 23:19:35.866516 5564 tablet_bootstrap.cc:492] T 28916c96469e45e18e944e1c00e86d4c P 33b23bde919041e6b0e9010140e79b63: No bootstrap required, opened a new log
I20260618 23:19:35.866555 5564 ts_tablet_manager.cc:1397] T 28916c96469e45e18e944e1c00e86d4c P 33b23bde919041e6b0e9010140e79b63: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:35.866550 5044 catalog_manager.cc:4841] TS 978fe91bc3da40d794e285bf427be36a (127.3.217.129:42727): tablet 759b1ad15e764a968f3ab5675b26a38d (table test-table [id=f9c5e9741198458f8af513fd579dca3a]) successfully deleted
I20260618 23:19:35.866664 5195 tablet_service.cc:1467] Processing CreateTablet for tablet 28916c96469e45e18e944e1c00e86d4c (DEFAULT_TABLE table=test-table [id=cb1a1d4ed3dd4f0bb8fc1b5066c2def8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:35.866801 5195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28916c96469e45e18e944e1c00e86d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:35.866822 5475 tablet_service.cc:1467] Processing CreateTablet for tablet 28916c96469e45e18e944e1c00e86d4c (DEFAULT_TABLE table=test-table [id=cb1a1d4ed3dd4f0bb8fc1b5066c2def8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:35.866930 5475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28916c96469e45e18e944e1c00e86d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:35.866890 5564 raft_consensus.cc:348] T 28916c96469e45e18e944e1c00e86d4c P 33b23bde919041e6b0e9010140e79b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:35.866969 5564 raft_consensus.cc:374] T 28916c96469e45e18e944e1c00e86d4c P 33b23bde919041e6b0e9010140e79b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:35.866993 5564 raft_consensus.cc:729] T 28916c96469e45e18e944e1c00e86d4c P 33b23bde919041e6b0e9010140e79b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33b23bde919041e6b0e9010140e79b63, State: Initialized, Role: FOLLOWER
I20260618 23:19:35.867041 5564 consensus_queue.cc:260] T 28916c96469e45e18e944e1c00e86d4c P 33b23bde919041e6b0e9010140e79b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:35.867137 5564 ts_tablet_manager.cc:1428] T 28916c96469e45e18e944e1c00e86d4c P 33b23bde919041e6b0e9010140e79b63: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260618 23:19:35.868036 5568 tablet_bootstrap.cc:492] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384: Bootstrap starting.
I20260618 23:19:35.868105 5565 tablet_bootstrap.cc:492] T 28916c96469e45e18e944e1c00e86d4c P 978fe91bc3da40d794e285bf427be36a: Bootstrap starting.
I20260618 23:19:35.868475 5568 tablet_bootstrap.cc:654] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:35.868521 5565 tablet_bootstrap.cc:654] T 28916c96469e45e18e944e1c00e86d4c P 978fe91bc3da40d794e285bf427be36a: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:35.869191 5568 tablet_bootstrap.cc:492] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384: No bootstrap required, opened a new log
I20260618 23:19:35.869239 5568 ts_tablet_manager.cc:1397] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260618 23:19:35.869374 5568 raft_consensus.cc:348] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:35.869443 5568 raft_consensus.cc:374] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:35.869464 5568 raft_consensus.cc:729] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71187c1517aa495e9233bf975b223384, State: Initialized, Role: FOLLOWER
I20260618 23:19:35.869516 5568 consensus_queue.cc:260] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:35.869602 5568 ts_tablet_manager.cc:1428] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260618 23:19:35.870086 5565 tablet_bootstrap.cc:492] T 28916c96469e45e18e944e1c00e86d4c P 978fe91bc3da40d794e285bf427be36a: No bootstrap required, opened a new log
I20260618 23:19:35.870136 5565 ts_tablet_manager.cc:1397] T 28916c96469e45e18e944e1c00e86d4c P 978fe91bc3da40d794e285bf427be36a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260618 23:19:35.870263 5565 raft_consensus.cc:348] T 28916c96469e45e18e944e1c00e86d4c P 978fe91bc3da40d794e285bf427be36a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:35.870357 5565 raft_consensus.cc:374] T 28916c96469e45e18e944e1c00e86d4c P 978fe91bc3da40d794e285bf427be36a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:35.870384 5565 raft_consensus.cc:729] T 28916c96469e45e18e944e1c00e86d4c P 978fe91bc3da40d794e285bf427be36a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978fe91bc3da40d794e285bf427be36a, State: Initialized, Role: FOLLOWER
I20260618 23:19:35.870433 5565 consensus_queue.cc:260] T 28916c96469e45e18e944e1c00e86d4c P 978fe91bc3da40d794e285bf427be36a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:35.870533 5565 ts_tablet_manager.cc:1428] T 28916c96469e45e18e944e1c00e86d4c P 978fe91bc3da40d794e285bf427be36a: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260618 23:19:35.871114 5589 ts_tablet_manager.cc:1905] T 759b1ad15e764a968f3ab5675b26a38d P 71187c1517aa495e9233bf975b223384: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:19:35.872848 5589 ts_tablet_manager.cc:1918] T 759b1ad15e764a968f3ab5675b26a38d P 71187c1517aa495e9233bf975b223384: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:19:35.872931 5589 log.cc:1196] T 759b1ad15e764a968f3ab5675b26a38d P 71187c1517aa495e9233bf975b223384: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/759b1ad15e764a968f3ab5675b26a38d
I20260618 23:19:35.873195 5589 ts_tablet_manager.cc:1939] T 759b1ad15e764a968f3ab5675b26a38d P 71187c1517aa495e9233bf975b223384: Deleting consensus metadata
I20260618 23:19:35.873718 5045 catalog_manager.cc:4841] TS 71187c1517aa495e9233bf975b223384 (127.3.217.131:33933): tablet 759b1ad15e764a968f3ab5675b26a38d (table test-table [id=f9c5e9741198458f8af513fd579dca3a]) successfully deleted
I20260618 23:19:36.020288 5572 raft_consensus.cc:482] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:19:36.020422 5572 raft_consensus.cc:504] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:36.020809 5572 leader_election.cc:288] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978fe91bc3da40d794e285bf427be36a (127.3.217.129:42727), 33b23bde919041e6b0e9010140e79b63 (127.3.217.130:39027)
I20260618 23:19:36.025267 5559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:36.021359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:50899 (local address 127.3.217.129:42727)
0618 23:19:36.021426 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:36.021428 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:36.021533 (+ 105us) server_negotiation.cc:407] Connection header received
0618 23:19:36.021608 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:36.021610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:36.021622 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:36.021696 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:36.021896 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.022595 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.024044 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.024753 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.024877 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:36.024888 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:36.025131 (+ 243us) server_negotiation.cc:299] Negotiation successful
0618 23:19:36.025199 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260618 23:19:36.025264 5595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:36.021293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:42727 (local address 127.3.217.131:50899)
0618 23:19:36.021452 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:36.021463 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:36.021530 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:36.021736 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:36.021737 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:36.021739 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:36.021812 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:36.021814 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.022675 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.022676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:36.023917 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:36.023920 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.024917 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.024918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:36.024994 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:36.024999 (+ 5us) client_negotiation.cc:769] Sending connection context
0618 23:19:36.025076 (+ 77us) client_negotiation.cc:240] Negotiation successful
0618 23:19:36.025131 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":36,"thread_start_us":57,"threads_started":1}
I20260618 23:19:36.025267 5561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:36.021284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:33819 (local address 127.3.217.130:39027)
0618 23:19:36.021331 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:36.021334 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:36.021342 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:19:36.021367 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:36.021367 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:36.021378 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:36.021438 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:36.021624 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.022414 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.024060 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.024769 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.024877 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:36.024888 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:36.025138 (+ 250us) server_negotiation.cc:299] Negotiation successful
0618 23:19:36.025201 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260618 23:19:36.025264 5594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:36.021051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:39027 (local address 127.3.217.131:33819)
0618 23:19:36.021176 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:36.021189 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:36.021275 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:36.021465 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:36.021466 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:36.021468 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:36.021547 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:36.021550 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.022539 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.022540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:36.023961 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:36.023963 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.024946 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.024947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:36.025014 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:36.025017 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:19:36.025076 (+ 59us) client_negotiation.cc:240] Negotiation successful
0618 23:19:36.025131 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"mutex_wait_us":61,"thread_start_us":83,"threads_started":1}
I20260618 23:19:36.025841 5355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28916c96469e45e18e944e1c00e86d4c" candidate_uuid: "71187c1517aa495e9233bf975b223384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33b23bde919041e6b0e9010140e79b63" is_pre_election: true
I20260618 23:19:36.025923 5355 raft_consensus.cc:2454] T 28916c96469e45e18e944e1c00e86d4c P 33b23bde919041e6b0e9010140e79b63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71187c1517aa495e9233bf975b223384 in term 0.
I20260618 23:19:36.025835 5215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28916c96469e45e18e944e1c00e86d4c" candidate_uuid: "71187c1517aa495e9233bf975b223384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978fe91bc3da40d794e285bf427be36a" is_pre_election: true
I20260618 23:19:36.025979 5215 raft_consensus.cc:2454] T 28916c96469e45e18e944e1c00e86d4c P 978fe91bc3da40d794e285bf427be36a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71187c1517aa495e9233bf975b223384 in term 0.
I20260618 23:19:36.026202 5428 leader_election.cc:302] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71187c1517aa495e9233bf975b223384, 978fe91bc3da40d794e285bf427be36a; no voters:
I20260618 23:19:36.026351 5572 raft_consensus.cc:2781] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:19:36.026394 5572 raft_consensus.cc:482] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:19:36.026413 5572 raft_consensus.cc:3037] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:36.027187 5572 raft_consensus.cc:504] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:36.027336 5572 leader_election.cc:288] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384 [CANDIDATE]: Term 1 election: Requested vote from peers 978fe91bc3da40d794e285bf427be36a (127.3.217.129:42727), 33b23bde919041e6b0e9010140e79b63 (127.3.217.130:39027)
I20260618 23:19:36.027478 5215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28916c96469e45e18e944e1c00e86d4c" candidate_uuid: "71187c1517aa495e9233bf975b223384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978fe91bc3da40d794e285bf427be36a"
I20260618 23:19:36.027561 5215 raft_consensus.cc:3037] T 28916c96469e45e18e944e1c00e86d4c P 978fe91bc3da40d794e285bf427be36a [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:36.028415 5215 raft_consensus.cc:2454] T 28916c96469e45e18e944e1c00e86d4c P 978fe91bc3da40d794e285bf427be36a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71187c1517aa495e9233bf975b223384 in term 1.
I20260618 23:19:36.028584 5355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28916c96469e45e18e944e1c00e86d4c" candidate_uuid: "71187c1517aa495e9233bf975b223384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33b23bde919041e6b0e9010140e79b63"
I20260618 23:19:36.028614 5428 leader_election.cc:302] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71187c1517aa495e9233bf975b223384, 978fe91bc3da40d794e285bf427be36a; no voters:
I20260618 23:19:36.028666 5355 raft_consensus.cc:3037] T 28916c96469e45e18e944e1c00e86d4c P 33b23bde919041e6b0e9010140e79b63 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:36.028756 5572 raft_consensus.cc:2781] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:36.028923 5572 raft_consensus.cc:686] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384 [term 1 LEADER]: Becoming Leader. State: Replica: 71187c1517aa495e9233bf975b223384, State: Running, Role: LEADER
I20260618 23:19:36.029013 5572 consensus_queue.cc:237] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:36.029481 5355 raft_consensus.cc:2454] T 28916c96469e45e18e944e1c00e86d4c P 33b23bde919041e6b0e9010140e79b63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71187c1517aa495e9233bf975b223384 in term 1.
I20260618 23:19:36.029944 5057 catalog_manager.cc:5495] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71187c1517aa495e9233bf975b223384 (127.3.217.131). New cstate: current_term: 1 leader_uuid: "71187c1517aa495e9233bf975b223384" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } health_report { overall_health: HEALTHY } } }
Jun 18 23:19:36 dist-test-slave-r9ct krb5kdc[5013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824774, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:36.091516 5603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:36.083725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:41419 (local address 127.0.0.1:38086)
0618 23:19:36.083907 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:36.083918 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:36.083964 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:36.084307 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:36.084307 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:36.084629 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:36.084689 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:36.084691 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.085418 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.085419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:36.085935 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:36.085937 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.086413 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.086414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:36.086490 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:36.087074 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:36.087078 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:36.088475 (+ 1397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:36.090150 (+ 1675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:36.090157 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:36.090159 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:36.090363 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:36.090593 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:36.090593 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:36.090594 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:36.090739 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:36.091103 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:36.091109 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:36.091151 (+ 42us) client_negotiation.cc:769] Sending connection context
0618 23:19:36.091233 (+ 82us) client_negotiation.cc:240] Negotiation successful
0618 23:19:36.091347 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":96,"threads_started":1}
I20260618 23:19:36.091567 5604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:36.083928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38086 (local address 127.3.217.190:41419)
0618 23:19:36.084136 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:36.084137 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:36.084147 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:19:36.084168 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:36.084169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:36.084178 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:36.084298 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:36.084781 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.085326 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.086026 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.086209 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.086383 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:36.088679 (+ 2296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:36.088681 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:36.088681 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:36.088688 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:36.090048 (+ 1360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:36.090448 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:36.090449 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:36.090449 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:36.090526 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:36.090856 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:36.090857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:36.090858 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:36.091047 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:36.091111 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:36.091280 (+ 169us) server_negotiation.cc:299] Negotiation successful
0618 23:19:36.091400 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":175,"thread_start_us":111,"threads_started":1}
I20260618 23:19:36.094305 5057 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:38086:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260618 23:19:36.094499 5057 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:19:36.096354 5195 tablet_service.cc:1467] Processing CreateTablet for tablet fc8c2c41f24745d0b738bcb9aaa4ca45 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6e448142a79549daaff649f35c6edb3e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260618 23:19:36.096448 5335 tablet_service.cc:1467] Processing CreateTablet for tablet fc8c2c41f24745d0b738bcb9aaa4ca45 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6e448142a79549daaff649f35c6edb3e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260618 23:19:36.096583 5195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc8c2c41f24745d0b738bcb9aaa4ca45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:36.096633 5335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc8c2c41f24745d0b738bcb9aaa4ca45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:36.097770 5564 tablet_bootstrap.cc:492] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63: Bootstrap starting.
I20260618 23:19:36.098114 5565 tablet_bootstrap.cc:492] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 978fe91bc3da40d794e285bf427be36a: Bootstrap starting.
I20260618 23:19:36.098238 5564 tablet_bootstrap.cc:654] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:36.098243 5475 tablet_service.cc:1467] Processing CreateTablet for tablet fc8c2c41f24745d0b738bcb9aaa4ca45 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6e448142a79549daaff649f35c6edb3e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260618 23:19:36.098475 5565 tablet_bootstrap.cc:654] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 978fe91bc3da40d794e285bf427be36a: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:36.098563 5475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc8c2c41f24745d0b738bcb9aaa4ca45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:36.099152 5564 tablet_bootstrap.cc:492] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63: No bootstrap required, opened a new log
I20260618 23:19:36.099224 5564 ts_tablet_manager.cc:1397] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260618 23:19:36.099378 5564 raft_consensus.cc:348] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:36.099459 5564 raft_consensus.cc:374] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:36.099493 5564 raft_consensus.cc:729] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33b23bde919041e6b0e9010140e79b63, State: Initialized, Role: FOLLOWER
I20260618 23:19:36.099545 5564 consensus_queue.cc:260] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:36.099640 5564 ts_tablet_manager.cc:1428] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:36.099720 5569 tablet_replica.cc:439] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } } }
I20260618 23:19:36.099828 5569 tablet_replica.cc:442] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63: This TxnStatusTablet replica's current role is: FOLLOWER
I20260618 23:19:36.100291 5568 tablet_bootstrap.cc:492] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 71187c1517aa495e9233bf975b223384: Bootstrap starting.
I20260618 23:19:36.100883 5565 tablet_bootstrap.cc:492] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 978fe91bc3da40d794e285bf427be36a: No bootstrap required, opened a new log
I20260618 23:19:36.100960 5565 ts_tablet_manager.cc:1397] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 978fe91bc3da40d794e285bf427be36a: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260618 23:19:36.100780 5568 tablet_bootstrap.cc:654] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 71187c1517aa495e9233bf975b223384: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:36.101089 5565 raft_consensus.cc:348] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 978fe91bc3da40d794e285bf427be36a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:36.101167 5565 raft_consensus.cc:374] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 978fe91bc3da40d794e285bf427be36a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:36.101191 5565 raft_consensus.cc:729] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 978fe91bc3da40d794e285bf427be36a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978fe91bc3da40d794e285bf427be36a, State: Initialized, Role: FOLLOWER
I20260618 23:19:36.101254 5565 consensus_queue.cc:260] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 978fe91bc3da40d794e285bf427be36a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:36.101351 5565 ts_tablet_manager.cc:1428] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 978fe91bc3da40d794e285bf427be36a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:36.101413 5575 tablet_replica.cc:439] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 978fe91bc3da40d794e285bf427be36a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } } }
I20260618 23:19:36.101514 5575 tablet_replica.cc:442] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 978fe91bc3da40d794e285bf427be36a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260618 23:19:36.101877 5568 tablet_bootstrap.cc:492] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 71187c1517aa495e9233bf975b223384: No bootstrap required, opened a new log
I20260618 23:19:36.101933 5568 ts_tablet_manager.cc:1397] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 71187c1517aa495e9233bf975b223384: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260618 23:19:36.102239 5568 raft_consensus.cc:348] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 71187c1517aa495e9233bf975b223384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:36.102480 5568 raft_consensus.cc:374] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 71187c1517aa495e9233bf975b223384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:36.102530 5568 raft_consensus.cc:729] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 71187c1517aa495e9233bf975b223384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71187c1517aa495e9233bf975b223384, State: Initialized, Role: FOLLOWER
I20260618 23:19:36.102587 5568 consensus_queue.cc:260] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 71187c1517aa495e9233bf975b223384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:36.102685 5568 ts_tablet_manager.cc:1428] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 71187c1517aa495e9233bf975b223384: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260618 23:19:36.102803 5572 tablet_replica.cc:439] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 71187c1517aa495e9233bf975b223384: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } } }
I20260618 23:19:36.102943 5572 tablet_replica.cc:442] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 71187c1517aa495e9233bf975b223384: This TxnStatusTablet replica's current role is: FOLLOWER
I20260618 23:19:36.135747 5569 raft_consensus.cc:482] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:19:36.135854 5569 raft_consensus.cc:504] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:36.136292 5569 leader_election.cc:288] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 978fe91bc3da40d794e285bf427be36a (127.3.217.129:42727), 71187c1517aa495e9233bf975b223384 (127.3.217.131:33933)
I20260618 23:19:36.140484 5609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:36.136500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:42727 (local address 127.3.217.130:44971)
0618 23:19:36.136729 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:36.136741 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:36.136815 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:36.137024 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:36.137025 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:36.137027 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:36.137114 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:36.137116 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.138219 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.138220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:36.139334 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:36.139337 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.140181 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.140182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:36.140289 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:36.140294 (+ 5us) client_negotiation.cc:769] Sending connection context
0618 23:19:36.140353 (+ 59us) client_negotiation.cc:240] Negotiation successful
0618 23:19:36.140391 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":113,"threads_started":1}
I20260618 23:19:36.140511 5559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:36.136777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:44971 (local address 127.3.217.129:42727)
0618 23:19:36.136831 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:36.136834 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:36.136870 (+ 36us) server_negotiation.cc:407] Connection header received
0618 23:19:36.136903 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:36.136904 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:36.136912 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:36.136979 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:36.137421 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.138120 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.139432 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.140043 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.140124 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:36.140135 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:36.140390 (+ 255us) server_negotiation.cc:299] Negotiation successful
0618 23:19:36.140441 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260618 23:19:36.141040 5215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc8c2c41f24745d0b738bcb9aaa4ca45" candidate_uuid: "33b23bde919041e6b0e9010140e79b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978fe91bc3da40d794e285bf427be36a" is_pre_election: true
I20260618 23:19:36.141140 5215 raft_consensus.cc:2454] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 978fe91bc3da40d794e285bf427be36a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33b23bde919041e6b0e9010140e79b63 in term 0.
I20260618 23:19:36.141382 5288 leader_election.cc:302] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33b23bde919041e6b0e9010140e79b63, 978fe91bc3da40d794e285bf427be36a; no voters:
I20260618 23:19:36.141500 5569 raft_consensus.cc:2781] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:19:36.141520 5608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:36.136506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:33933 (local address 127.3.217.130:46599)
0618 23:19:36.137248 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:36.137257 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:36.137336 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:36.137554 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:36.137555 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:36.137556 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:36.137648 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:36.137650 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.138693 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.138695 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:36.139892 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:36.139895 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.141234 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.141235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:36.141311 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:36.141315 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:19:36.141403 (+ 88us) client_negotiation.cc:240] Negotiation successful
0618 23:19:36.141446 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":727,"thread_start_us":158,"threads_started":1}
I20260618 23:19:36.141527 5569 raft_consensus.cc:482] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:19:36.141580 5569 raft_consensus.cc:3037] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:36.141573 5560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:36.136844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:46599 (local address 127.3.217.131:33933)
0618 23:19:36.136892 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:36.136894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:36.137361 (+ 467us) server_negotiation.cc:407] Connection header received
0618 23:19:36.137404 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:36.137404 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:36.137441 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:36.137486 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:36.137783 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.138563 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.140011 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.141119 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.141191 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:36.141200 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:36.141415 (+ 215us) server_negotiation.cc:299] Negotiation successful
0618 23:19:36.141479 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260618 23:19:36.141848 5495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc8c2c41f24745d0b738bcb9aaa4ca45" candidate_uuid: "33b23bde919041e6b0e9010140e79b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71187c1517aa495e9233bf975b223384" is_pre_election: true
I20260618 23:19:36.141928 5495 raft_consensus.cc:2454] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 71187c1517aa495e9233bf975b223384 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33b23bde919041e6b0e9010140e79b63 in term 0.
I20260618 23:19:36.142565 5569 raft_consensus.cc:504] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:36.142741 5569 leader_election.cc:288] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63 [CANDIDATE]: Term 1 election: Requested vote from peers 978fe91bc3da40d794e285bf427be36a (127.3.217.129:42727), 71187c1517aa495e9233bf975b223384 (127.3.217.131:33933)
I20260618 23:19:36.142877 5495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc8c2c41f24745d0b738bcb9aaa4ca45" candidate_uuid: "33b23bde919041e6b0e9010140e79b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71187c1517aa495e9233bf975b223384"
I20260618 23:19:36.142940 5495 raft_consensus.cc:3037] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 71187c1517aa495e9233bf975b223384 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:36.142915 5215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc8c2c41f24745d0b738bcb9aaa4ca45" candidate_uuid: "33b23bde919041e6b0e9010140e79b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "978fe91bc3da40d794e285bf427be36a"
I20260618 23:19:36.142992 5215 raft_consensus.cc:3037] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 978fe91bc3da40d794e285bf427be36a [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:36.143457 5495 raft_consensus.cc:2454] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 71187c1517aa495e9233bf975b223384 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33b23bde919041e6b0e9010140e79b63 in term 1.
I20260618 23:19:36.143672 5289 leader_election.cc:302] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33b23bde919041e6b0e9010140e79b63, 71187c1517aa495e9233bf975b223384; no voters:
I20260618 23:19:36.143849 5569 raft_consensus.cc:2781] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:36.144001 5569 raft_consensus.cc:686] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63 [term 1 LEADER]: Becoming Leader. State: Replica: 33b23bde919041e6b0e9010140e79b63, State: Running, Role: LEADER
I20260618 23:19:36.144012 5215 raft_consensus.cc:2454] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 978fe91bc3da40d794e285bf427be36a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33b23bde919041e6b0e9010140e79b63 in term 1.
I20260618 23:19:36.144086 5569 consensus_queue.cc:237] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } }
I20260618 23:19:36.144497 5610 tablet_replica.cc:439] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63: TxnStatusTablet state changed. Reason: New leader 33b23bde919041e6b0e9010140e79b63. Latest consensus state: current_term: 1 leader_uuid: "33b23bde919041e6b0e9010140e79b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } } }
I20260618 23:19:36.144591 5610 tablet_replica.cc:442] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63: This TxnStatusTablet replica's current role is: LEADER
I20260618 23:19:36.144773 5612 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260618 23:19:36.144878 5612 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260618 23:19:36.144917 5057 catalog_manager.cc:5495] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33b23bde919041e6b0e9010140e79b63 (127.3.217.130). New cstate: current_term: 1 leader_uuid: "33b23bde919041e6b0e9010140e79b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } health_report { overall_health: UNKNOWN } } }
I20260618 23:19:36.153568 5561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:36.151339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47636 (local address 127.3.217.130:39027)
0618 23:19:36.151398 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:36.151400 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:36.151409 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:19:36.151477 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:36.151478 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:36.151495 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:36.151558 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:19:36.151662 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.152127 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.152838 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.153026 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.153099 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:36.153265 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:19:36.153354 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:19:36.153432 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:36.153483 (+ 51us) server_negotiation.cc:299] Negotiation successful
0618 23:19:36.153502 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260618 23:19:36.153599 5603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:36.151272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:39027 (local address 127.0.0.1:47636)
0618 23:19:36.151344 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:36.151356 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:36.151401 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:36.151561 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:36.151562 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:36.151563 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0618 23:19:36.151606 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:36.151608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.152212 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.152213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:36.152758 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:36.152760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.153097 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.153098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:36.153156 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:36.153170 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0618 23:19:36.153429 (+ 259us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0618 23:19:36.153437 (+ 8us) client_negotiation.cc:769] Sending connection context
0618 23:19:36.153481 (+ 44us) client_negotiation.cc:240] Negotiation successful
0618 23:19:36.153526 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260618 23:19:36.154646 5495 raft_consensus.cc:1261] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 71187c1517aa495e9233bf975b223384 [term 1 FOLLOWER]: Refusing update from remote peer 33b23bde919041e6b0e9010140e79b63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:19:36.154744 5215 raft_consensus.cc:1261] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 978fe91bc3da40d794e285bf427be36a [term 1 FOLLOWER]: Refusing update from remote peer 33b23bde919041e6b0e9010140e79b63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:19:36.154927 5610 consensus_queue.cc:1035] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:19:36.155017 5569 consensus_queue.cc:1035] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:19:36.155617 5575 tablet_replica.cc:439] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 978fe91bc3da40d794e285bf427be36a: TxnStatusTablet state changed. Reason: New leader 33b23bde919041e6b0e9010140e79b63. Latest consensus state: current_term: 1 leader_uuid: "33b23bde919041e6b0e9010140e79b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } } }
I20260618 23:19:36.155629 5572 tablet_replica.cc:439] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 71187c1517aa495e9233bf975b223384: TxnStatusTablet state changed. Reason: New leader 33b23bde919041e6b0e9010140e79b63. Latest consensus state: current_term: 1 leader_uuid: "33b23bde919041e6b0e9010140e79b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } } }
I20260618 23:19:36.155706 5575 tablet_replica.cc:442] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 978fe91bc3da40d794e285bf427be36a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260618 23:19:36.155714 5572 tablet_replica.cc:442] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 71187c1517aa495e9233bf975b223384: This TxnStatusTablet replica's current role is: FOLLOWER
I20260618 23:19:36.156418 5569 tablet_replica.cc:439] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "33b23bde919041e6b0e9010140e79b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } } }
I20260618 23:19:36.156493 5569 tablet_replica.cc:442] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63: This TxnStatusTablet replica's current role is: LEADER
I20260618 23:19:36.156581 5569 tablet_replica.cc:439] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "33b23bde919041e6b0e9010140e79b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } } }
I20260618 23:19:36.156623 5569 tablet_replica.cc:442] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 33b23bde919041e6b0e9010140e79b63: This TxnStatusTablet replica's current role is: LEADER
I20260618 23:19:36.156769 5575 tablet_replica.cc:439] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 978fe91bc3da40d794e285bf427be36a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "33b23bde919041e6b0e9010140e79b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } } }
I20260618 23:19:36.156862 5575 tablet_replica.cc:442] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 978fe91bc3da40d794e285bf427be36a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260618 23:19:36.156822 5578 mvcc.cc:205] Tried to move back new op lower bound from 7298354283127504896 to 7298354283086528512. Current Snapshot: MvccSnapshot[applied={T|T < 7298354283127504896}]
I20260618 23:19:36.157559 5572 tablet_replica.cc:439] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 71187c1517aa495e9233bf975b223384: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "33b23bde919041e6b0e9010140e79b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 } } peers { permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 } } peers { permanent_uuid: "71187c1517aa495e9233bf975b223384" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33933 } } }
I20260618 23:19:36.157645 5572 tablet_replica.cc:442] T fc8c2c41f24745d0b738bcb9aaa4ca45 P 71187c1517aa495e9233bf975b223384: This TxnStatusTablet replica's current role is: FOLLOWER
I20260618 23:19:36.160989 5560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:36.158219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53910 (local address 127.3.217.131:33933)
0618 23:19:36.158356 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:36.158357 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:36.158364 (+ 7us) server_negotiation.cc:407] Connection header received
0618 23:19:36.158397 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:36.158398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:36.158421 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:36.158500 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:19:36.158603 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.159222 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.160292 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.160480 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.160528 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:36.160675 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:19:36.160757 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:19:36.160804 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:36.160871 (+ 67us) server_negotiation.cc:299] Negotiation successful
0618 23:19:36.160884 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260618 23:19:36.166862 5619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:36.163559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:39027 (local address 127.3.217.131:60729)
0618 23:19:36.163721 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:36.163732 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:36.163777 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:36.163979 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:36.163980 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:36.163981 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0618 23:19:36.164048 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:36.164050 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.164919 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.164920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:36.165883 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:36.165885 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.166259 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.166259 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:36.166322 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:36.166336 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0618 23:19:36.166594 (+ 258us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0618 23:19:36.166595 (+ 1us) client_negotiation.cc:769] Sending connection context
0618 23:19:36.166662 (+ 67us) client_negotiation.cc:240] Negotiation successful
0618 23:19:36.166703 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":81,"threads_started":1}
I20260618 23:19:36.166890 5561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:36.163720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:60729 (local address 127.3.217.130:39027)
0618 23:19:36.163772 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:36.163782 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:36.163799 (+ 17us) server_negotiation.cc:407] Connection header received
0618 23:19:36.163842 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:36.163843 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:36.163853 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:36.163973 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:19:36.164158 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.164723 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.165984 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.166177 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.166235 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:36.166461 (+ 226us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:19:36.166507 (+ 46us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:19:36.166579 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:36.166668 (+ 89us) server_negotiation.cc:299] Negotiation successful
0618 23:19:36.166694 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260618 23:19:36.169279 5355 raft_consensus.cc:1261] T 28916c96469e45e18e944e1c00e86d4c P 33b23bde919041e6b0e9010140e79b63 [term 1 FOLLOWER]: Refusing update from remote peer 71187c1517aa495e9233bf975b223384: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:19:36.169286 5215 raft_consensus.cc:1261] T 28916c96469e45e18e944e1c00e86d4c P 978fe91bc3da40d794e285bf427be36a [term 1 FOLLOWER]: Refusing update from remote peer 71187c1517aa495e9233bf975b223384: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:19:36.169657 5596 consensus_queue.cc:1035] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "978fe91bc3da40d794e285bf427be36a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:19:36.169797 5572 consensus_queue.cc:1035] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33b23bde919041e6b0e9010140e79b63" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 39027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:19:36.178846 5560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:36.175756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:34045 (local address 127.3.217.131:33933)
0618 23:19:36.175797 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:36.175799 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:36.176000 (+ 201us) server_negotiation.cc:407] Connection header received
0618 23:19:36.176098 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:36.176099 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:36.176108 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:36.176150 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:19:36.176299 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.176813 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.178163 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.178364 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.178418 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:36.178601 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:19:36.178624 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:19:36.178661 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:36.178754 (+ 93us) server_negotiation.cc:299] Negotiation successful
0618 23:19:36.178773 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260618 23:19:36.178882 5625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:36.175661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:33933 (local address 127.3.217.130:34045)
0618 23:19:36.175882 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:36.175893 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:36.176028 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:36.176155 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:36.176156 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:36.176157 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0618 23:19:36.176225 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:36.176227 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.176892 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.176892 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:36.178074 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:36.178077 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.178441 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.178442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:36.178507 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:36.178523 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0618 23:19:36.178664 (+ 141us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0618 23:19:36.178665 (+ 1us) client_negotiation.cc:769] Sending connection context
0618 23:19:36.178731 (+ 66us) client_negotiation.cc:240] Negotiation successful
0618 23:19:36.178770 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":110,"threads_started":1}
I20260618 23:19:36.188063 5057 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:19:36.188177 5057 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:19:36.188802 5057 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8d48ff01cff1425cbedeba8c17d0b86c: Sending DeleteTablet for 3 replicas of tablet 28916c96469e45e18e944e1c00e86d4c
I20260618 23:19:36.189040 5475 tablet_service.cc:1514] Processing DeleteTablet for tablet 28916c96469e45e18e944e1c00e86d4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:36 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:53902
I20260618 23:19:36.189147 5589 tablet_replica.cc:330] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384: stopping tablet replica
I20260618 23:19:36.189195 5589 raft_consensus.cc:2229] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384 [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:19:36.189287 5589 raft_consensus.cc:2258] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:36.189517 5195 tablet_service.cc:1514] Processing DeleteTablet for tablet 28916c96469e45e18e944e1c00e86d4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:36 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:59244
I20260618 23:19:36.189595 5589 ts_tablet_manager.cc:1905] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:19:36.189618 5590 tablet_replica.cc:330] T 28916c96469e45e18e944e1c00e86d4c P 978fe91bc3da40d794e285bf427be36a: stopping tablet replica
I20260618 23:19:36.189694 5590 raft_consensus.cc:2229] T 28916c96469e45e18e944e1c00e86d4c P 978fe91bc3da40d794e285bf427be36a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:19:36.189706 5335 tablet_service.cc:1514] Processing DeleteTablet for tablet 28916c96469e45e18e944e1c00e86d4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:36 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:47632
I20260618 23:19:36.189731 5590 raft_consensus.cc:2258] T 28916c96469e45e18e944e1c00e86d4c P 978fe91bc3da40d794e285bf427be36a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:36.189782 5588 tablet_replica.cc:330] T 28916c96469e45e18e944e1c00e86d4c P 33b23bde919041e6b0e9010140e79b63: stopping tablet replica
I20260618 23:19:36.189823 5588 raft_consensus.cc:2229] T 28916c96469e45e18e944e1c00e86d4c P 33b23bde919041e6b0e9010140e79b63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:19:36.189853 5588 raft_consensus.cc:2258] T 28916c96469e45e18e944e1c00e86d4c P 33b23bde919041e6b0e9010140e79b63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:36.190052 5590 ts_tablet_manager.cc:1905] T 28916c96469e45e18e944e1c00e86d4c P 978fe91bc3da40d794e285bf427be36a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:19:36.191145 5589 ts_tablet_manager.cc:1918] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260618 23:19:36.191202 5589 log.cc:1196] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/28916c96469e45e18e944e1c00e86d4c
I20260618 23:19:36.191422 5589 ts_tablet_manager.cc:1939] T 28916c96469e45e18e944e1c00e86d4c P 71187c1517aa495e9233bf975b223384: Deleting consensus metadata
I20260618 23:19:36.191740 5590 ts_tablet_manager.cc:1918] T 28916c96469e45e18e944e1c00e86d4c P 978fe91bc3da40d794e285bf427be36a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260618 23:19:36.191978 5590 log.cc:1196] T 28916c96469e45e18e944e1c00e86d4c P 978fe91bc3da40d794e285bf427be36a: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-0/wal/wals/28916c96469e45e18e944e1c00e86d4c
I20260618 23:19:36.191993 5045 catalog_manager.cc:4841] TS 71187c1517aa495e9233bf975b223384 (127.3.217.131:33933): tablet 28916c96469e45e18e944e1c00e86d4c (table test-table [id=cb1a1d4ed3dd4f0bb8fc1b5066c2def8]) successfully deleted
I20260618 23:19:36.192056 5588 ts_tablet_manager.cc:1905] T 28916c96469e45e18e944e1c00e86d4c P 33b23bde919041e6b0e9010140e79b63: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:19:36.192305 5590 ts_tablet_manager.cc:1939] T 28916c96469e45e18e944e1c00e86d4c P 978fe91bc3da40d794e285bf427be36a: Deleting consensus metadata
I20260618 23:19:36.192662 5044 catalog_manager.cc:4841] TS 978fe91bc3da40d794e285bf427be36a (127.3.217.129:42727): tablet 28916c96469e45e18e944e1c00e86d4c (table test-table [id=cb1a1d4ed3dd4f0bb8fc1b5066c2def8]) successfully deleted
I20260618 23:19:36.193463 5588 ts_tablet_manager.cc:1918] T 28916c96469e45e18e944e1c00e86d4c P 33b23bde919041e6b0e9010140e79b63: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260618 23:19:36.193502 5588 log.cc:1196] T 28916c96469e45e18e944e1c00e86d4c P 33b23bde919041e6b0e9010140e79b63: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/28916c96469e45e18e944e1c00e86d4c
I20260618 23:19:36.193652 5588 ts_tablet_manager.cc:1939] T 28916c96469e45e18e944e1c00e86d4c P 33b23bde919041e6b0e9010140e79b63: Deleting consensus metadata
I20260618 23:19:36.194149 5043 catalog_manager.cc:4841] TS 33b23bde919041e6b0e9010140e79b63 (127.3.217.130:39027): tablet 28916c96469e45e18e944e1c00e86d4c (table test-table [id=cb1a1d4ed3dd4f0bb8fc1b5066c2def8]) successfully deleted
Jun 18 23:19:36 dist-test-slave-r9ct krb5kdc[5013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824775, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.3.217.129@KRBTEST.COM
I20260618 23:19:36.202702 5559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:36.191709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59266 (local address 127.3.217.129:42727)
0618 23:19:36.191840 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:36.191842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:36.194965 (+ 3123us) server_negotiation.cc:407] Connection header received
0618 23:19:36.195035 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:36.195036 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:36.195052 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:36.195105 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:36.195800 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.196267 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.197004 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.197190 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.197261 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:36.200031 (+ 2770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:36.200039 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:36.200040 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:36.200047 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:36.201576 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:36.201930 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:36.201933 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:36.201934 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:36.201991 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:36.202183 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:36.202184 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:36.202185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:36.202314 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:36.202462 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:36.202535 (+ 73us) server_negotiation.cc:299] Negotiation successful
0618 23:19:36.202612 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260618 23:19:36.203049 5245 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59266
I20260618 23:19:36.209939 5604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:36.203939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38090 (local address 127.3.217.190:41419)
0618 23:19:36.204055 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:36.204057 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:36.204109 (+ 52us) server_negotiation.cc:407] Connection header received
0618 23:19:36.204181 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:36.204182 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:36.204193 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:36.204248 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:36.204718 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.205204 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.205906 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:36.206125 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:36.206197 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:36.207448 (+ 1251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:36.207450 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:36.207450 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:36.207456 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:36.208805 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:36.209157 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:36.209158 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:36.209158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:36.209208 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:36.209420 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:36.209421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:36.209421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:36.209530 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:36.209636 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:36.209731 (+ 95us) server_negotiation.cc:299] Negotiation successful
0618 23:19:36.209809 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
W20260618 23:19:36.210131 5057 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38090
I20260618 23:19:36.210749 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 5130
I20260618 23:19:36.218194 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 5270
I20260618 23:19:36.225171 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 5410
I20260618 23:19:36.230880 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 5026
2026-06-18T23:19:36Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2664 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:19:36 dist-test-slave-r9ct krb5kdc[5635](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:19:36 dist-test-slave-r9ct krb5kdc[5635](info): set up 2 sockets
Jun 18 23:19:36 dist-test-slave-r9ct krb5kdc[5635](info): commencing operation
krb5kdc: starting...
W20260618 23:19:37.306442 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.054s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:19:37 dist-test-slave-r9ct krb5kdc[5635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:19:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:19:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:19:37.431066 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:42963
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:44499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:42963
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:37.519630 5648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:37.519884 5648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:37.519917 5648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:37.521642 5648 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:19:37.521697 5648 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260618 23:19:37.521713 5648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:37.521727 5648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:37.521741 5648 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:19:37.521816 5648 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:19:37.523624 5648 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:44499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:42963
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:42963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:37.523895 5648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:37.524130 5648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:37.529340 5654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:37.529347 5653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:37.529402 5656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:37.529419 5648 server_base.cc:1034] running on GCE node
I20260618 23:19:37.529779 5648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:37.530047 5648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:37.531222 5648 hybrid_clock.cc:648] HybridClock initialized: now 1781824777531161 us; error 96 us; skew 500 ppm
Jun 18 23:19:37 dist-test-slave-r9ct krb5kdc[5635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824777, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:37.533797 5648 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:19:37.534278 5648 webserver.cc:460] Webserver started at http://127.3.217.190:44777/ using document root <none> and password file <none>
I20260618 23:19:37.534528 5648 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:37.534595 5648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:37.534781 5648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:37.535880 5648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "d5bf8983721e4d95a0da588ef24ce5f2"
format_stamp: "Formatted at 2026-06-18 23:19:37 on dist-test-slave-r9ct"
server_key: "6bc10b41c17d968d76c16cd52dfeb8cd"
server_key_iv: "14ef250c7490dde3dfe90af0330dff0f"
server_key_version: "encryptionkey@0"
I20260618 23:19:37.536240 5648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "d5bf8983721e4d95a0da588ef24ce5f2"
format_stamp: "Formatted at 2026-06-18 23:19:37 on dist-test-slave-r9ct"
server_key: "6bc10b41c17d968d76c16cd52dfeb8cd"
server_key_iv: "14ef250c7490dde3dfe90af0330dff0f"
server_key_version: "encryptionkey@0"
I20260618 23:19:37.537649 5648 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:19:37.538537 5663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:37.538793 5648 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:37.538889 5648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "d5bf8983721e4d95a0da588ef24ce5f2"
format_stamp: "Formatted at 2026-06-18 23:19:37 on dist-test-slave-r9ct"
server_key: "6bc10b41c17d968d76c16cd52dfeb8cd"
server_key_iv: "14ef250c7490dde3dfe90af0330dff0f"
server_key_version: "encryptionkey@0"
I20260618 23:19:37.538976 5648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:37.584769 5648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:37.587191 5648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:37.587368 5648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:37.592676 5648 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:42963
I20260618 23:19:37.592732 5725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:42963 every 8 connection(s)
I20260618 23:19:37.593086 5648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:19:37.593727 5726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:37.596017 5726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2: Bootstrap starting.
I20260618 23:19:37.596590 5726 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:37.596869 5726 log.cc:824] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:37.597523 5726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2: No bootstrap required, opened a new log
I20260618 23:19:37.597919 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 5648
I20260618 23:19:37.598039 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:19:37.598213 3942 external_mini_cluster.cc:1428] Setting key 41eb216beb57bca75ceb46ff07d492e7
I20260618 23:19:37.600553 5726 raft_consensus.cc:348] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5bf8983721e4d95a0da588ef24ce5f2" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42963 } }
I20260618 23:19:37.600729 5726 raft_consensus.cc:374] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:37.600778 5726 raft_consensus.cc:729] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5bf8983721e4d95a0da588ef24ce5f2, State: Initialized, Role: FOLLOWER
I20260618 23:19:37.600917 5726 consensus_queue.cc:260] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5bf8983721e4d95a0da588ef24ce5f2" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42963 } }
I20260618 23:19:37.601014 5726 raft_consensus.cc:388] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:19:37.601058 5726 raft_consensus.cc:482] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:19:37.601107 5726 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:37.601915 5726 raft_consensus.cc:504] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5bf8983721e4d95a0da588ef24ce5f2" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42963 } }
I20260618 23:19:37.602041 5726 leader_election.cc:302] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d5bf8983721e4d95a0da588ef24ce5f2; no voters:
I20260618 23:19:37.602242 5726 leader_election.cc:288] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:19:37.602276 5731 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:37.602450 5731 raft_consensus.cc:686] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2 [term 1 LEADER]: Becoming Leader. State: Replica: d5bf8983721e4d95a0da588ef24ce5f2, State: Running, Role: LEADER
I20260618 23:19:37.602519 5726 sys_catalog.cc:564] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:19:37.602540 5731 consensus_queue.cc:237] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5bf8983721e4d95a0da588ef24ce5f2" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42963 } }
I20260618 23:19:37.602921 5733 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d5bf8983721e4d95a0da588ef24ce5f2. Latest consensus state: current_term: 1 leader_uuid: "d5bf8983721e4d95a0da588ef24ce5f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5bf8983721e4d95a0da588ef24ce5f2" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42963 } } }
I20260618 23:19:37.602934 5732 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d5bf8983721e4d95a0da588ef24ce5f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5bf8983721e4d95a0da588ef24ce5f2" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42963 } } }
I20260618 23:19:37.603204 5732 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2 [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:37.603469 5733 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2 [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:37.603516 5740 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:19:37.604085 5740 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:19:37.606273 5740 catalog_manager.cc:1347] Generated new cluster ID: ae7822c3b9f64da796b35b90e09f7a0b
I20260618 23:19:37.606346 5740 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 18 23:19:37 dist-test-slave-r9ct krb5kdc[5635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:37.611588 5730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:37.598822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39186 (local address 127.3.217.190:42963)
0618 23:19:37.598991 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:37.598998 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:37.599022 (+ 24us) server_negotiation.cc:407] Connection header received
0618 23:19:37.600122 (+ 1100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:37.600134 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:37.600223 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:37.600475 (+ 252us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:37.601490 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:37.602801 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:37.604129 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:37.604683 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:37.604802 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:37.608002 (+ 3200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:37.608006 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:37.608006 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:37.608018 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:37.609902 (+ 1884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:37.610307 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:37.610310 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:37.610310 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:37.610418 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:37.610630 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:37.610631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:37.610631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:37.610969 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:37.611124 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:37.611258 (+ 134us) server_negotiation.cc:299] Negotiation successful
0618 23:19:37.611395 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":66,"threads_started":1}
I20260618 23:19:37.611968 5740 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:19:37.612708 5740 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:19:37.626091 5740 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2: Generated new TSK 0
I20260618 23:19:37.626500 5740 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.217.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
I20260618 23:19:37.659117 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:42963
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:44499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:37.743566 5752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:37.743777 5752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:37.743803 5752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:37.745076 5752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:37.745121 5752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:37.745143 5752 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260618 23:19:37.745157 5752 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260618 23:19:37.745174 5752 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:19:37.746903 5752 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:44499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.217.190:42963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5752
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:37.747153 5752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:37.747403 5752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:37.753209 5757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:37.753157 5752 server_base.cc:1034] running on GCE node
W20260618 23:19:37.753132 5758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:37.753176 5760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:37.753561 5752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:37.753765 5752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:37.755026 5752 hybrid_clock.cc:648] HybridClock initialized: now 1781824777755013 us; error 24 us; skew 500 ppm
Jun 18 23:19:37 dist-test-slave-r9ct krb5kdc[5635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824777, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:37.757507 5752 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:19:37.758024 5752 webserver.cc:460] Webserver started at http://127.3.217.129:34343/ using document root <none> and password file <none>
I20260618 23:19:37.758257 5752 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:37.758329 5752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:37.758495 5752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:37.759673 5752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "567aad74196e41e58e3f38882cdd0cc3"
format_stamp: "Formatted at 2026-06-18 23:19:37 on dist-test-slave-r9ct"
server_key: "9da6688d8355def1b5b0d6e6bdca0f8b"
server_key_iv: "1585e96b889f381804bbf7626d4ca674"
server_key_version: "encryptionkey@0"
I20260618 23:19:37.760064 5752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "567aad74196e41e58e3f38882cdd0cc3"
format_stamp: "Formatted at 2026-06-18 23:19:37 on dist-test-slave-r9ct"
server_key: "9da6688d8355def1b5b0d6e6bdca0f8b"
server_key_iv: "1585e96b889f381804bbf7626d4ca674"
server_key_version: "encryptionkey@0"
I20260618 23:19:37.761448 5752 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260618 23:19:37.762292 5767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:37.762475 5752 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:37.762578 5752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "567aad74196e41e58e3f38882cdd0cc3"
format_stamp: "Formatted at 2026-06-18 23:19:37 on dist-test-slave-r9ct"
server_key: "9da6688d8355def1b5b0d6e6bdca0f8b"
server_key_iv: "1585e96b889f381804bbf7626d4ca674"
server_key_version: "encryptionkey@0"
I20260618 23:19:37.762665 5752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:37.778162 5752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:37.780459 5752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:37.780634 5752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:37.781167 5752 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:37.781224 5752 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:37.781261 5752 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:37.781282 5752 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 18 23:19:37 dist-test-slave-r9ct krb5kdc[5635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824777, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:37.788545 5752 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:39407
I20260618 23:19:37.788857 5882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:39407 every 8 connection(s)
I20260618 23:19:37.788951 5752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:19:37.791699 5730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:37.781671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:52567 (local address 127.3.217.190:42963)
0618 23:19:37.781744 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:37.781746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:37.782002 (+ 256us) server_negotiation.cc:407] Connection header received
0618 23:19:37.782748 (+ 746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:37.782750 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:37.782763 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:37.782828 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:37.783765 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:37.784288 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:37.785287 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:37.785488 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:37.785579 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:37.788246 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:37.788247 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:37.788248 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:37.788254 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:37.790028 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:37.790561 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:37.790562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:37.790563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:37.790652 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:37.790950 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:37.790951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:37.790951 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:37.791087 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:37.791162 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:37.791468 (+ 306us) server_negotiation.cc:299] Negotiation successful
0618 23:19:37.791593 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260618 23:19:37.791910 5776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:37.781640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:42963 (local address 127.3.217.129:52567)
0618 23:19:37.781839 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:37.781887 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:37.782586 (+ 699us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:37.782931 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:37.782937 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:37.783332 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:37.783654 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:37.783662 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:37.784390 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:37.784391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:37.785191 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:37.785193 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:37.785602 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:37.785604 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:37.785744 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:37.786254 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:37.786266 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:37.788119 (+ 1853us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:37.790147 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:37.790161 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:37.790164 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:37.790445 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:37.790749 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:37.790750 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:37.790750 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:37.790869 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:37.791152 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:37.791159 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:37.791321 (+ 162us) client_negotiation.cc:769] Sending connection context
0618 23:19:37.791434 (+ 113us) client_negotiation.cc:240] Negotiation successful
0618 23:19:37.791627 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":96,"threads_started":1}
I20260618 23:19:37.792542 5883 heartbeater.cc:347] Connected to a master server at 127.3.217.190:42963
I20260618 23:19:37.792697 5883 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:37.792912 5883 heartbeater.cc:511] Master 127.3.217.190:42963 requested a full tablet report, sending...
I20260618 23:19:37.793646 5679 ts_manager.cc:194] Registered new tserver with Master: 567aad74196e41e58e3f38882cdd0cc3 (127.3.217.129:39407)
I20260618 23:19:37.793879 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 5752
I20260618 23:19:37.793974 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:19:37.794159 3942 external_mini_cluster.cc:1428] Setting key b78c42a7a97ff4db9f9afccc97e025a1
I20260618 23:19:37.794548 5679 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:52567
I20260618 23:19:37.800997 5730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:37.793735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:59779 (local address 127.3.217.190:42963)
0618 23:19:37.793807 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:37.793809 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:37.793874 (+ 65us) server_negotiation.cc:407] Connection header received
0618 23:19:37.793940 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:37.793940 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:37.793951 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:37.794020 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:37.794394 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:37.795117 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:37.796261 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:37.796748 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:37.796874 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:37.797976 (+ 1102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:37.797978 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:37.797978 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:37.797985 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:37.799837 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:37.800210 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:37.800211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:37.800212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:37.800267 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:37.800477 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:37.800478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:37.800479 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:37.800597 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:37.800673 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:37.800833 (+ 160us) server_negotiation.cc:299] Negotiation successful
0618 23:19:37.800905 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260618 23:19:37.801002 5889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:37.793662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:42963 (local address 127.3.217.129:59779)
0618 23:19:37.793813 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:37.793824 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:37.793889 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:37.794022 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:37.794023 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:37.794248 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:37.794329 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:37.794330 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:37.795230 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:37.795231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:37.796140 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:37.796142 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:37.796878 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:37.796880 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:37.796977 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:37.797600 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:37.797605 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:37.797883 (+ 278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:37.799941 (+ 2058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:37.799942 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:37.799943 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:37.800126 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:37.800353 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:37.800354 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:37.800354 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:37.800412 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:37.800664 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:37.800665 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:37.800712 (+ 47us) client_negotiation.cc:769] Sending connection context
0618 23:19:37.800798 (+ 86us) client_negotiation.cc:240] Negotiation successful
0618 23:19:37.800905 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":82,"threads_started":1}
WARNING: no policy specified for kudu/127.3.217.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
I20260618 23:19:37.825827 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:42963
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:44499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:37.906579 5892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:37.906840 5892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:37.906873 5892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:37.907989 5892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:37.908030 5892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:37.908051 5892 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260618 23:19:37.908062 5892 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260618 23:19:37.908102 5892 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:19:37.909520 5892 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:44499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.217.190:42963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5892
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:37.909751 5892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:37.909973 5892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:37.915197 5898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:37.915302 5892 server_base.cc:1034] running on GCE node
W20260618 23:19:37.915243 5900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:37.915243 5897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:37.915719 5892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:37.916004 5892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:37.917189 5892 hybrid_clock.cc:648] HybridClock initialized: now 1781824777917156 us; error 68 us; skew 500 ppm
Jun 18 23:19:37 dist-test-slave-r9ct krb5kdc[5635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824777, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:37.919907 5892 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:19:37.920377 5892 webserver.cc:460] Webserver started at http://127.3.217.130:41051/ using document root <none> and password file <none>
I20260618 23:19:37.920598 5892 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:37.920670 5892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:37.920825 5892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:37.921840 5892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f"
format_stamp: "Formatted at 2026-06-18 23:19:37 on dist-test-slave-r9ct"
server_key: "b41c05c21937b18b6f1f2c11a7e867a5"
server_key_iv: "a2d2266d9812cb0f5eeee36aab0daff6"
server_key_version: "encryptionkey@0"
I20260618 23:19:37.922297 5892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f"
format_stamp: "Formatted at 2026-06-18 23:19:37 on dist-test-slave-r9ct"
server_key: "b41c05c21937b18b6f1f2c11a7e867a5"
server_key_iv: "a2d2266d9812cb0f5eeee36aab0daff6"
server_key_version: "encryptionkey@0"
I20260618 23:19:37.923702 5892 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260618 23:19:37.924522 5907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:37.924715 5892 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:19:37.924834 5892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f"
format_stamp: "Formatted at 2026-06-18 23:19:37 on dist-test-slave-r9ct"
server_key: "b41c05c21937b18b6f1f2c11a7e867a5"
server_key_iv: "a2d2266d9812cb0f5eeee36aab0daff6"
server_key_version: "encryptionkey@0"
I20260618 23:19:37.924908 5892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:37.939019 5892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:37.941303 5892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:37.941465 5892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:37.941982 5892 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:37.942057 5892 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:37.942107 5892 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:37.942138 5892 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 18 23:19:37 dist-test-slave-r9ct krb5kdc[5635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824777, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:37.949285 6022 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:33013 every 8 connection(s)
I20260618 23:19:37.949572 5892 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:33013
I20260618 23:19:37.949996 5892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:19:37.950695 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 5892
I20260618 23:19:37.950843 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:19:37.951032 3942 external_mini_cluster.cc:1428] Setting key 9e362fe8331d9ba14535063b8dc24d8f
I20260618 23:19:37.953441 5730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:37.942563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:60779 (local address 127.3.217.190:42963)
0618 23:19:37.942618 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:37.942621 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:37.942816 (+ 195us) server_negotiation.cc:407] Connection header received
0618 23:19:37.943282 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:37.943283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:37.943295 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:37.943386 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:37.944092 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:37.944918 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:37.946491 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:37.946860 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:37.946945 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:37.949808 (+ 2863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:37.949810 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:37.949810 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:37.949817 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:37.951558 (+ 1741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:37.952036 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:37.952037 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:37.952038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:37.952098 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:37.952319 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:37.952320 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:37.952320 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:37.952459 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:37.952525 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:37.953263 (+ 738us) server_negotiation.cc:299] Negotiation successful
0618 23:19:37.953352 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260618 23:19:37.953647 5916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:37.942529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:42963 (local address 127.3.217.130:60779)
0618 23:19:37.942673 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:37.942712 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:37.943184 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:37.943440 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:37.943443 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:37.943690 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:37.943986 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:37.943992 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:37.945033 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:37.945034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:37.946392 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:37.946394 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:37.946972 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:37.946973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:37.947099 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:37.947639 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:37.947650 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:37.949702 (+ 2052us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:37.951715 (+ 2013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:37.951720 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:37.951722 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:37.951958 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:37.952166 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:37.952167 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:37.952167 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:37.952257 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:37.952567 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:37.952573 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:37.952910 (+ 337us) client_negotiation.cc:769] Sending connection context
0618 23:19:37.953107 (+ 197us) client_negotiation.cc:240] Negotiation successful
0618 23:19:37.953413 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":83,"threads_started":1}
I20260618 23:19:37.954107 6023 heartbeater.cc:347] Connected to a master server at 127.3.217.190:42963
I20260618 23:19:37.954183 6023 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:37.954370 6023 heartbeater.cc:511] Master 127.3.217.190:42963 requested a full tablet report, sending...
I20260618 23:19:37.954732 5679 ts_manager.cc:194] Registered new tserver with Master: b98b43a3d9e94ba2818fa7d3d2b0f59f (127.3.217.130:33013)
I20260618 23:19:37.955188 5679 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:60779
WARNING: no policy specified for kudu/127.3.217.131@KRBTEST.COM; defaulting to no policy
I20260618 23:19:37.961849 6030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:37.955167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:42963 (local address 127.3.217.130:36121)
0618 23:19:37.955356 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:37.955367 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:37.955448 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:37.956005 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:37.956005 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:37.956185 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:37.956230 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:37.956231 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:37.956857 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:37.956858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:37.957343 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:37.957344 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:37.957722 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:37.957723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:37.957802 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:37.958263 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:37.958268 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:37.958570 (+ 302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:37.960731 (+ 2161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:37.960732 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:37.960733 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:37.960913 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:37.961172 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:37.961173 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:37.961173 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:37.961231 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:37.961517 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:37.961518 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:37.961563 (+ 45us) client_negotiation.cc:769] Sending connection context
0618 23:19:37.961651 (+ 88us) client_negotiation.cc:240] Negotiation successful
0618 23:19:37.961751 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":137,"threads_started":1}
I20260618 23:19:37.961870 5730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:37.955184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:36121 (local address 127.3.217.190:42963)
0618 23:19:37.955222 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:37.955224 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:37.955423 (+ 199us) server_negotiation.cc:407] Connection header received
0618 23:19:37.955938 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:37.955939 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:37.955951 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:37.956002 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:37.956311 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:37.956767 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:37.957445 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:37.957638 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:37.957721 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:37.958738 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:37.958739 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:37.958739 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:37.958747 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:37.960477 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:37.961001 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:37.961002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:37.961002 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:37.961063 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:37.961307 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:37.961308 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:37.961308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:37.961444 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:37.961526 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:37.961677 (+ 151us) server_negotiation.cc:299] Negotiation successful
0618 23:19:37.961759 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
I20260618 23:19:37.979075 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:42963
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:44499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:38.062350 6032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:38.062592 6032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:38.062630 6032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:38.063777 6032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:38.063845 6032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:38.063882 6032 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260618 23:19:38.063930 6032 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260618 23:19:38.063967 6032 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:19:38.065430 6032 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:44499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.217.190:42963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6032
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:38.065716 6032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:38.065945 6032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260618 23:19:38.071319 6032 server_base.cc:1034] running on GCE node
W20260618 23:19:38.071319 6038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:38.071328 6037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:38.071328 6040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:38.071973 6032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:38.072486 6032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:38.073685 6032 hybrid_clock.cc:648] HybridClock initialized: now 1781824778073698 us; error 111 us; skew 500 ppm
Jun 18 23:19:38 dist-test-slave-r9ct krb5kdc[5635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824778, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:38.076473 6032 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:19:38.076962 6032 webserver.cc:460] Webserver started at http://127.3.217.131:36393/ using document root <none> and password file <none>
I20260618 23:19:38.077188 6032 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:38.077255 6032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:38.077445 6032 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:38.078589 6032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "c7ac1a31326d41578dd4829e82e2f97b"
format_stamp: "Formatted at 2026-06-18 23:19:38 on dist-test-slave-r9ct"
server_key: "066a8a7a66c0b284ef521ce6142705d5"
server_key_iv: "9cf75ee9562848a68c781a743102be81"
server_key_version: "encryptionkey@0"
I20260618 23:19:38.079066 6032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "c7ac1a31326d41578dd4829e82e2f97b"
format_stamp: "Formatted at 2026-06-18 23:19:38 on dist-test-slave-r9ct"
server_key: "066a8a7a66c0b284ef521ce6142705d5"
server_key_iv: "9cf75ee9562848a68c781a743102be81"
server_key_version: "encryptionkey@0"
I20260618 23:19:38.080438 6032 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:38.081265 6047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:38.081461 6032 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:38.081569 6032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "c7ac1a31326d41578dd4829e82e2f97b"
format_stamp: "Formatted at 2026-06-18 23:19:38 on dist-test-slave-r9ct"
server_key: "066a8a7a66c0b284ef521ce6142705d5"
server_key_iv: "9cf75ee9562848a68c781a743102be81"
server_key_version: "encryptionkey@0"
I20260618 23:19:38.081650 6032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:38.101423 6032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:38.104627 6032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:38.104799 6032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:38.105403 6032 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:38.105461 6032 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:38.105505 6032 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:38.105532 6032 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 18 23:19:38 dist-test-slave-r9ct krb5kdc[5635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824778, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:38.113195 6032 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:45473
I20260618 23:19:38.113260 6162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:45473 every 8 connection(s)
I20260618 23:19:38.113549 6032 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:19:38.115417 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 6032
I20260618 23:19:38.115487 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:19:38.115664 3942 external_mini_cluster.cc:1428] Setting key 2c40a0504cea98aec57836cc3e0d2fff
I20260618 23:19:38.116226 5730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.105889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:43197 (local address 127.3.217.190:42963)
0618 23:19:38.105942 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:38.105944 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:38.106164 (+ 220us) server_negotiation.cc:407] Connection header received
0618 23:19:38.106635 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:38.106636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:38.106649 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:38.106747 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:38.107589 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.108419 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.110095 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.110416 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.110491 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.113216 (+ 2725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:38.113217 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:38.113218 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:38.113225 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:38.114857 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:38.115271 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:38.115272 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:38.115273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:38.115328 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:38.115591 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:38.115592 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:38.115592 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:38.115733 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:38.115796 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:38.116061 (+ 265us) server_negotiation.cc:299] Negotiation successful
0618 23:19:38.116136 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260618 23:19:38.116402 6056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.105881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:42963 (local address 127.3.217.131:43197)
0618 23:19:38.106032 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:38.106071 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:38.106540 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:38.106844 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:38.106848 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:38.107186 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:38.107489 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.107494 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.108541 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.108542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.109998 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.110002 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.110517 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.110518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.110680 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.111190 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:38.111202 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:38.113124 (+ 1922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:38.114955 (+ 1831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:38.114961 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:38.114963 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:38.115180 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:38.115406 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:38.115407 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:38.115408 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:38.115535 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:38.115787 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:38.115793 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:38.115931 (+ 138us) client_negotiation.cc:769] Sending connection context
0618 23:19:38.116041 (+ 110us) client_negotiation.cc:240] Negotiation successful
0618 23:19:38.116193 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":89,"threads_started":1}
I20260618 23:19:38.116909 6163 heartbeater.cc:347] Connected to a master server at 127.3.217.190:42963
I20260618 23:19:38.116986 6163 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:38.117163 6163 heartbeater.cc:511] Master 127.3.217.190:42963 requested a full tablet report, sending...
I20260618 23:19:38.117479 5679 ts_manager.cc:194] Registered new tserver with Master: c7ac1a31326d41578dd4829e82e2f97b (127.3.217.131:45473)
I20260618 23:19:38.117964 5679 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:43197
I20260618 23:19:38.124111 6169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.117865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:42963 (local address 127.3.217.131:46653)
0618 23:19:38.117997 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:38.118006 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:38.118048 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:38.118212 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:38.118213 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:38.118410 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:38.118471 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.118473 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.119494 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.119495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.120040 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.120042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.120474 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.120475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.120536 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.120968 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:38.120973 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:38.121230 (+ 257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:38.123085 (+ 1855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:38.123086 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:38.123086 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:38.123252 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:38.123452 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:38.123453 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:38.123453 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:38.123505 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:38.123836 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:38.123836 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:38.123875 (+ 39us) client_negotiation.cc:769] Sending connection context
0618 23:19:38.123954 (+ 79us) client_negotiation.cc:240] Negotiation successful
0618 23:19:38.124031 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":70,"threads_started":1}
I20260618 23:19:38.124150 5730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.118101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:46653 (local address 127.3.217.190:42963)
0618 23:19:38.118134 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:38.118135 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:38.118141 (+ 6us) server_negotiation.cc:407] Connection header received
0618 23:19:38.118155 (+ 14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:38.118155 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:38.118163 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:38.118199 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:38.118662 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.119338 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.120177 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.120359 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.120428 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.121370 (+ 942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:38.121371 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:38.121371 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:38.121377 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:38.123002 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:38.123345 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:38.123345 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:38.123346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:38.123394 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:38.123596 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:38.123597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:38.123597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:38.123734 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:38.123804 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:38.124025 (+ 221us) server_negotiation.cc:299] Negotiation successful
0618 23:19:38.124092 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260618 23:19:38.127799 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 18 23:19:38 dist-test-slave-r9ct krb5kdc[5635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824778, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 18 23:19:38 dist-test-slave-r9ct krb5kdc[5635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824778, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:38.155733 5730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.147051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39200 (local address 127.3.217.190:42963)
0618 23:19:38.147126 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:38.147128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:38.147138 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:19:38.147165 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:38.147166 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:38.147175 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:38.147248 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:38.147845 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.148343 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.149204 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.149405 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.149503 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.152937 (+ 3434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:38.152939 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:38.152939 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:38.152947 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:38.154339 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:38.154690 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:38.154692 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:38.154692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:38.154775 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:38.154992 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:38.154993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:38.154993 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:38.155154 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:38.155327 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:38.155545 (+ 218us) server_negotiation.cc:299] Negotiation successful
0618 23:19:38.155626 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260618 23:19:38.157387 5679 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39200:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:19:38.159169 5679 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:19:38.166112 6184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.161956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53498 (local address 127.3.217.130:33013)
0618 23:19:38.162107 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:38.162113 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:38.162123 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:19:38.162166 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:38.162168 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:38.162186 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:38.162274 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:38.162521 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.163471 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.164912 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.165616 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.165704 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.165764 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:38.165962 (+ 198us) server_negotiation.cc:299] Negotiation successful
0618 23:19:38.166004 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":81,"threads_started":1}
I20260618 23:19:38.166106 6181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.161743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:39407 (local address 127.0.0.1:47518)
0618 23:19:38.162222 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:38.162231 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:38.162270 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:38.162564 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:38.162565 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:38.162566 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:38.162607 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.162609 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.163923 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.163924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.164970 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.164972 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.165854 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.165854 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.165910 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.165913 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:19:38.165959 (+ 46us) client_negotiation.cc:240] Negotiation successful
0618 23:19:38.166005 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"mutex_wait_us":5,"thread_start_us":91,"threads_started":1}
I20260618 23:19:38.166174 6180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.161735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:33013 (local address 127.0.0.1:53498)
0618 23:19:38.161883 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:38.161968 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:38.162036 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:38.162347 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:38.162350 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:38.162353 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:38.162432 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.162434 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.163589 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.163591 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.164818 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.164821 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.165760 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.165761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.165838 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.165862 (+ 24us) client_negotiation.cc:769] Sending connection context
0618 23:19:38.165932 (+ 70us) client_negotiation.cc:240] Negotiation successful
0618 23:19:38.165993 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":55,"threads_started":1}
I20260618 23:19:38.166384 6183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.161898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44646 (local address 127.3.217.131:45473)
0618 23:19:38.162380 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:38.162383 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:38.162418 (+ 35us) server_negotiation.cc:407] Connection header received
0618 23:19:38.162453 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:38.162455 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:38.162469 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:38.162539 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:38.162826 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.163878 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.164952 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.165697 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.165753 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.165795 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:38.166225 (+ 430us) server_negotiation.cc:299] Negotiation successful
0618 23:19:38.166272 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":81,"threads_started":1}
I20260618 23:19:38.166481 6185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.162141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47518 (local address 127.3.217.129:39407)
0618 23:19:38.162313 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:38.162318 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:38.162328 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:19:38.162367 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:38.162369 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:38.162385 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:38.162466 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:38.162698 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.163835 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.165048 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.165697 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.165767 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.165822 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:38.166319 (+ 497us) server_negotiation.cc:299] Negotiation successful
0618 23:19:38.166368 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":110,"threads_started":1}
I20260618 23:19:38.167101 6182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.161735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:45473 (local address 127.0.0.1:44646)
0618 23:19:38.162064 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:38.162076 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:38.162135 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:38.162536 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:38.162691 (+ 155us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:38.162694 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:38.162758 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.162760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.163964 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.163965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.164844 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.164846 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.165834 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.165835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.165880 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.165882 (+ 2us) client_negotiation.cc:769] Sending connection context
0618 23:19:38.165958 (+ 76us) client_negotiation.cc:240] Negotiation successful
0618 23:19:38.166010 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"mutex_wait_us":6,"thread_start_us":76,"threads_started":1}
I20260618 23:19:38.167140 5817 tablet_service.cc:1467] Processing CreateTablet for tablet 16ab01e9357a4ad2b257aacd021652b7 (DEFAULT_TABLE table=test-table [id=7c2d922bffe445f0a7a50b5b5f820c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:38.167194 5957 tablet_service.cc:1467] Processing CreateTablet for tablet 16ab01e9357a4ad2b257aacd021652b7 (DEFAULT_TABLE table=test-table [id=7c2d922bffe445f0a7a50b5b5f820c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:38.167510 5957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16ab01e9357a4ad2b257aacd021652b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:38.167510 5817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16ab01e9357a4ad2b257aacd021652b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:38.167703 6097 tablet_service.cc:1467] Processing CreateTablet for tablet 16ab01e9357a4ad2b257aacd021652b7 (DEFAULT_TABLE table=test-table [id=7c2d922bffe445f0a7a50b5b5f820c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:38.167999 6097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16ab01e9357a4ad2b257aacd021652b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:38.170284 6186 tablet_bootstrap.cc:492] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b: Bootstrap starting.
I20260618 23:19:38.171030 6188 tablet_bootstrap.cc:492] T 16ab01e9357a4ad2b257aacd021652b7 P b98b43a3d9e94ba2818fa7d3d2b0f59f: Bootstrap starting.
I20260618 23:19:38.171330 6186 tablet_bootstrap.cc:654] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:38.171636 6188 tablet_bootstrap.cc:654] T 16ab01e9357a4ad2b257aacd021652b7 P b98b43a3d9e94ba2818fa7d3d2b0f59f: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:38.171653 6186 log.cc:824] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:38.171958 6188 log.cc:824] T 16ab01e9357a4ad2b257aacd021652b7 P b98b43a3d9e94ba2818fa7d3d2b0f59f: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:38.172251 6187 tablet_bootstrap.cc:492] T 16ab01e9357a4ad2b257aacd021652b7 P 567aad74196e41e58e3f38882cdd0cc3: Bootstrap starting.
I20260618 23:19:38.172379 6186 tablet_bootstrap.cc:492] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b: No bootstrap required, opened a new log
I20260618 23:19:38.172446 6186 ts_tablet_manager.cc:1397] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:19:38.172777 6187 tablet_bootstrap.cc:654] T 16ab01e9357a4ad2b257aacd021652b7 P 567aad74196e41e58e3f38882cdd0cc3: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:38.173081 6187 log.cc:824] T 16ab01e9357a4ad2b257aacd021652b7 P 567aad74196e41e58e3f38882cdd0cc3: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:38.173581 6188 tablet_bootstrap.cc:492] T 16ab01e9357a4ad2b257aacd021652b7 P b98b43a3d9e94ba2818fa7d3d2b0f59f: No bootstrap required, opened a new log
I20260618 23:19:38.173662 6188 ts_tablet_manager.cc:1397] T 16ab01e9357a4ad2b257aacd021652b7 P b98b43a3d9e94ba2818fa7d3d2b0f59f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260618 23:19:38.173796 6187 tablet_bootstrap.cc:492] T 16ab01e9357a4ad2b257aacd021652b7 P 567aad74196e41e58e3f38882cdd0cc3: No bootstrap required, opened a new log
I20260618 23:19:38.173866 6187 ts_tablet_manager.cc:1397] T 16ab01e9357a4ad2b257aacd021652b7 P 567aad74196e41e58e3f38882cdd0cc3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:19:38.174232 6186 raft_consensus.cc:348] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } }
I20260618 23:19:38.174397 6186 raft_consensus.cc:374] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:38.174432 6186 raft_consensus.cc:729] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7ac1a31326d41578dd4829e82e2f97b, State: Initialized, Role: FOLLOWER
I20260618 23:19:38.174551 6186 consensus_queue.cc:260] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } }
I20260618 23:19:38.174851 6163 heartbeater.cc:503] Master 127.3.217.190:42963 was elected leader, sending a full tablet report...
I20260618 23:19:38.174834 6186 ts_tablet_manager.cc:1428] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260618 23:19:38.175716 6187 raft_consensus.cc:348] T 16ab01e9357a4ad2b257aacd021652b7 P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } }
I20260618 23:19:38.175889 6187 raft_consensus.cc:374] T 16ab01e9357a4ad2b257aacd021652b7 P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:38.175931 6187 raft_consensus.cc:729] T 16ab01e9357a4ad2b257aacd021652b7 P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567aad74196e41e58e3f38882cdd0cc3, State: Initialized, Role: FOLLOWER
I20260618 23:19:38.175863 6188 raft_consensus.cc:348] T 16ab01e9357a4ad2b257aacd021652b7 P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } }
I20260618 23:19:38.176018 6188 raft_consensus.cc:374] T 16ab01e9357a4ad2b257aacd021652b7 P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:38.176064 6188 raft_consensus.cc:729] T 16ab01e9357a4ad2b257aacd021652b7 P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98b43a3d9e94ba2818fa7d3d2b0f59f, State: Initialized, Role: FOLLOWER
I20260618 23:19:38.176064 6187 consensus_queue.cc:260] T 16ab01e9357a4ad2b257aacd021652b7 P 567aad74196e41e58e3f38882cdd0cc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } }
I20260618 23:19:38.176172 6188 consensus_queue.cc:260] T 16ab01e9357a4ad2b257aacd021652b7 P b98b43a3d9e94ba2818fa7d3d2b0f59f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } }
I20260618 23:19:38.176357 5883 heartbeater.cc:503] Master 127.3.217.190:42963 was elected leader, sending a full tablet report...
I20260618 23:19:38.176354 6187 ts_tablet_manager.cc:1428] T 16ab01e9357a4ad2b257aacd021652b7 P 567aad74196e41e58e3f38882cdd0cc3: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260618 23:19:38.176427 6023 heartbeater.cc:503] Master 127.3.217.190:42963 was elected leader, sending a full tablet report...
I20260618 23:19:38.176663 6188 ts_tablet_manager.cc:1428] T 16ab01e9357a4ad2b257aacd021652b7 P b98b43a3d9e94ba2818fa7d3d2b0f59f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260618 23:19:38.200660 6024 tablet.cc:2369] T 16ab01e9357a4ad2b257aacd021652b7 P b98b43a3d9e94ba2818fa7d3d2b0f59f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260618 23:19:38.289780 5884 tablet.cc:2369] T 16ab01e9357a4ad2b257aacd021652b7 P 567aad74196e41e58e3f38882cdd0cc3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 23:19:38.311904 6192 raft_consensus.cc:482] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:19:38.312021 6192 raft_consensus.cc:504] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } }
I20260618 23:19:38.312342 6192 leader_election.cc:288] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98b43a3d9e94ba2818fa7d3d2b0f59f (127.3.217.130:33013), 567aad74196e41e58e3f38882cdd0cc3 (127.3.217.129:39407)
I20260618 23:19:38.315711 6056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.312496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:33013 (local address 127.3.217.131:54727)
0618 23:19:38.312542 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:38.312556 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:38.312602 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:38.312783 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:38.312784 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:38.312786 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:38.312864 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.312866 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.313880 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.313881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.314614 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.314616 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.315441 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.315442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.315524 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.315528 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:19:38.315599 (+ 71us) client_negotiation.cc:240] Negotiation successful
0618 23:19:38.315636 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260618 23:19:38.315866 6184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.312543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:54727 (local address 127.3.217.130:33013)
0618 23:19:38.312594 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:38.312596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:38.312607 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:19:38.312693 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:38.312694 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:38.312706 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:38.312769 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:38.312960 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.313659 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.314750 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.315355 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.315416 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.315424 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:38.315660 (+ 236us) server_negotiation.cc:299] Negotiation successful
0618 23:19:38.315729 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260618 23:19:38.316188 6185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.312611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:38383 (local address 127.3.217.129:39407)
0618 23:19:38.312657 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:38.312659 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:38.312769 (+ 110us) server_negotiation.cc:407] Connection header received
0618 23:19:38.312849 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:38.312850 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:38.312858 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:38.312919 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:38.313114 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.313668 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.315270 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.315818 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.315887 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.315895 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:38.316092 (+ 197us) server_negotiation.cc:299] Negotiation successful
0618 23:19:38.316126 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260618 23:19:38.316207 6195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.312510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:39407 (local address 127.3.217.131:38383)
0618 23:19:38.312689 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:38.312698 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:38.312770 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:38.312960 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:38.312961 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:38.312963 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:38.313038 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.313039 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.313807 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.313809 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.315162 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.315164 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.315943 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.315945 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.316030 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.316035 (+ 5us) client_negotiation.cc:769] Sending connection context
0618 23:19:38.316087 (+ 52us) client_negotiation.cc:240] Negotiation successful
0618 23:19:38.316123 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":120,"threads_started":1}
I20260618 23:19:38.316377 5977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16ab01e9357a4ad2b257aacd021652b7" candidate_uuid: "c7ac1a31326d41578dd4829e82e2f97b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" is_pre_election: true
I20260618 23:19:38.316591 5977 raft_consensus.cc:2454] T 16ab01e9357a4ad2b257aacd021652b7 P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7ac1a31326d41578dd4829e82e2f97b in term 0.
I20260618 23:19:38.317021 6051 leader_election.cc:302] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98b43a3d9e94ba2818fa7d3d2b0f59f, c7ac1a31326d41578dd4829e82e2f97b; no voters:
I20260618 23:19:38.317159 5837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16ab01e9357a4ad2b257aacd021652b7" candidate_uuid: "c7ac1a31326d41578dd4829e82e2f97b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567aad74196e41e58e3f38882cdd0cc3" is_pre_election: true
I20260618 23:19:38.317247 6192 raft_consensus.cc:2781] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:19:38.317301 6192 raft_consensus.cc:482] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:19:38.317333 6192 raft_consensus.cc:3037] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:38.317320 5837 raft_consensus.cc:2454] T 16ab01e9357a4ad2b257aacd021652b7 P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7ac1a31326d41578dd4829e82e2f97b in term 0.
I20260618 23:19:38.318074 6192 raft_consensus.cc:504] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } }
I20260618 23:19:38.318230 6192 leader_election.cc:288] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b [CANDIDATE]: Term 1 election: Requested vote from peers b98b43a3d9e94ba2818fa7d3d2b0f59f (127.3.217.130:33013), 567aad74196e41e58e3f38882cdd0cc3 (127.3.217.129:39407)
I20260618 23:19:38.318372 5837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16ab01e9357a4ad2b257aacd021652b7" candidate_uuid: "c7ac1a31326d41578dd4829e82e2f97b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567aad74196e41e58e3f38882cdd0cc3"
I20260618 23:19:38.318455 5837 raft_consensus.cc:3037] T 16ab01e9357a4ad2b257aacd021652b7 P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:38.318462 5977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16ab01e9357a4ad2b257aacd021652b7" candidate_uuid: "c7ac1a31326d41578dd4829e82e2f97b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f"
I20260618 23:19:38.318565 5977 raft_consensus.cc:3037] T 16ab01e9357a4ad2b257aacd021652b7 P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:38.319350 5837 raft_consensus.cc:2454] T 16ab01e9357a4ad2b257aacd021652b7 P 567aad74196e41e58e3f38882cdd0cc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7ac1a31326d41578dd4829e82e2f97b in term 1.
I20260618 23:19:38.319451 5977 raft_consensus.cc:2454] T 16ab01e9357a4ad2b257aacd021652b7 P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7ac1a31326d41578dd4829e82e2f97b in term 1.
I20260618 23:19:38.319850 6049 leader_election.cc:302] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567aad74196e41e58e3f38882cdd0cc3, c7ac1a31326d41578dd4829e82e2f97b; no voters:
I20260618 23:19:38.319954 6192 raft_consensus.cc:2781] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:38.320096 6192 raft_consensus.cc:686] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b [term 1 LEADER]: Becoming Leader. State: Replica: c7ac1a31326d41578dd4829e82e2f97b, State: Running, Role: LEADER
I20260618 23:19:38.320171 6192 consensus_queue.cc:237] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } }
I20260618 23:19:38.321063 5680 catalog_manager.cc:5495] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7ac1a31326d41578dd4829e82e2f97b (127.3.217.131). New cstate: current_term: 1 leader_uuid: "c7ac1a31326d41578dd4829e82e2f97b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } health_report { overall_health: UNKNOWN } } }
W20260618 23:19:38.364106 6164 tablet.cc:2369] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b: Can't schedule compaction. Clean time has not been advanced past its initial value.
Jun 18 23:19:38 dist-test-slave-r9ct krb5kdc[5635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824777, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:38.374994 6203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.367322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:42963 (local address 127.0.0.1:39204)
0618 23:19:38.367455 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:38.367466 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:38.367532 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:38.367718 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:38.367718 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:38.367987 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:38.368030 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.368032 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.368704 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.368705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.369246 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.369248 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.369869 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.369870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.369921 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.370471 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:38.370475 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:38.371828 (+ 1353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:38.373701 (+ 1873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:38.373707 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:38.373709 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:38.373922 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:38.374149 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:38.374149 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:38.374150 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:38.374214 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:38.374586 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:38.374598 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:38.374647 (+ 49us) client_negotiation.cc:769] Sending connection context
0618 23:19:38.374788 (+ 141us) client_negotiation.cc:240] Negotiation successful
0618 23:19:38.374878 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":61,"threads_started":1}
I20260618 23:19:38.375165 5730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.367413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39204 (local address 127.3.217.190:42963)
0618 23:19:38.367518 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:38.367520 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:38.367530 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:19:38.367579 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:38.367580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:38.367588 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:38.367639 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:38.368129 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.368618 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.369393 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.369655 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.369843 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.372012 (+ 2169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:38.372013 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:38.372013 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:38.372023 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:38.373611 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:38.374026 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:38.374027 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:38.374027 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:38.374082 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:38.374329 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:38.374330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:38.374331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:38.374486 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:38.374575 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:38.374858 (+ 283us) server_negotiation.cc:299] Negotiation successful
0618 23:19:38.374932 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260618 23:19:38.377743 5680 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:39204:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260618 23:19:38.378108 5680 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:19:38.380031 5817 tablet_service.cc:1467] Processing CreateTablet for tablet 825cf56da745436a9cf3002cd80461ae (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=592d3bebd34541e09ab2bf415b4d8cac]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260618 23:19:38.380071 5957 tablet_service.cc:1467] Processing CreateTablet for tablet 825cf56da745436a9cf3002cd80461ae (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=592d3bebd34541e09ab2bf415b4d8cac]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260618 23:19:38.380071 6097 tablet_service.cc:1467] Processing CreateTablet for tablet 825cf56da745436a9cf3002cd80461ae (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=592d3bebd34541e09ab2bf415b4d8cac]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260618 23:19:38.380203 5957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 825cf56da745436a9cf3002cd80461ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:38.380203 5817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 825cf56da745436a9cf3002cd80461ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:38.380223 6097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 825cf56da745436a9cf3002cd80461ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:38.381376 6186 tablet_bootstrap.cc:492] T 825cf56da745436a9cf3002cd80461ae P c7ac1a31326d41578dd4829e82e2f97b: Bootstrap starting.
I20260618 23:19:38.381691 6187 tablet_bootstrap.cc:492] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3: Bootstrap starting.
I20260618 23:19:38.381835 6186 tablet_bootstrap.cc:654] T 825cf56da745436a9cf3002cd80461ae P c7ac1a31326d41578dd4829e82e2f97b: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:38.382061 6187 tablet_bootstrap.cc:654] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:38.382366 6188 tablet_bootstrap.cc:492] T 825cf56da745436a9cf3002cd80461ae P b98b43a3d9e94ba2818fa7d3d2b0f59f: Bootstrap starting.
I20260618 23:19:38.382607 6186 tablet_bootstrap.cc:492] T 825cf56da745436a9cf3002cd80461ae P c7ac1a31326d41578dd4829e82e2f97b: No bootstrap required, opened a new log
I20260618 23:19:38.382666 6186 ts_tablet_manager.cc:1397] T 825cf56da745436a9cf3002cd80461ae P c7ac1a31326d41578dd4829e82e2f97b: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260618 23:19:38.382874 6186 raft_consensus.cc:348] T 825cf56da745436a9cf3002cd80461ae P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:38.382964 6186 raft_consensus.cc:374] T 825cf56da745436a9cf3002cd80461ae P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:38.382989 6186 raft_consensus.cc:729] T 825cf56da745436a9cf3002cd80461ae P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7ac1a31326d41578dd4829e82e2f97b, State: Initialized, Role: FOLLOWER
I20260618 23:19:38.383040 6186 consensus_queue.cc:260] T 825cf56da745436a9cf3002cd80461ae P c7ac1a31326d41578dd4829e82e2f97b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:38.383095 6188 tablet_bootstrap.cc:654] T 825cf56da745436a9cf3002cd80461ae P b98b43a3d9e94ba2818fa7d3d2b0f59f: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:38.383154 6186 ts_tablet_manager.cc:1428] T 825cf56da745436a9cf3002cd80461ae P c7ac1a31326d41578dd4829e82e2f97b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260618 23:19:38.383273 6192 tablet_replica.cc:439] T 825cf56da745436a9cf3002cd80461ae P c7ac1a31326d41578dd4829e82e2f97b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } } }
I20260618 23:19:38.383347 6192 tablet_replica.cc:442] T 825cf56da745436a9cf3002cd80461ae P c7ac1a31326d41578dd4829e82e2f97b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260618 23:19:38.383761 6188 tablet_bootstrap.cc:492] T 825cf56da745436a9cf3002cd80461ae P b98b43a3d9e94ba2818fa7d3d2b0f59f: No bootstrap required, opened a new log
I20260618 23:19:38.383816 6188 ts_tablet_manager.cc:1397] T 825cf56da745436a9cf3002cd80461ae P b98b43a3d9e94ba2818fa7d3d2b0f59f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:38.383939 6187 tablet_bootstrap.cc:492] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3: No bootstrap required, opened a new log
I20260618 23:19:38.384009 6187 ts_tablet_manager.cc:1397] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:19:38.383988 6188 raft_consensus.cc:348] T 825cf56da745436a9cf3002cd80461ae P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:38.384173 6188 raft_consensus.cc:374] T 825cf56da745436a9cf3002cd80461ae P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:38.384161 6187 raft_consensus.cc:348] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:38.384222 6188 raft_consensus.cc:729] T 825cf56da745436a9cf3002cd80461ae P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98b43a3d9e94ba2818fa7d3d2b0f59f, State: Initialized, Role: FOLLOWER
I20260618 23:19:38.384240 6187 raft_consensus.cc:374] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:38.384271 6187 raft_consensus.cc:729] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567aad74196e41e58e3f38882cdd0cc3, State: Initialized, Role: FOLLOWER
I20260618 23:19:38.384272 6188 consensus_queue.cc:260] T 825cf56da745436a9cf3002cd80461ae P b98b43a3d9e94ba2818fa7d3d2b0f59f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:38.384315 6187 consensus_queue.cc:260] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:38.384375 6188 ts_tablet_manager.cc:1428] T 825cf56da745436a9cf3002cd80461ae P b98b43a3d9e94ba2818fa7d3d2b0f59f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:38.384433 6187 ts_tablet_manager.cc:1428] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260618 23:19:38.384555 6193 tablet_replica.cc:439] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } } }
I20260618 23:19:38.384539 6194 tablet_replica.cc:439] T 825cf56da745436a9cf3002cd80461ae P b98b43a3d9e94ba2818fa7d3d2b0f59f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } } }
I20260618 23:19:38.384660 6193 tablet_replica.cc:442] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260618 23:19:38.384661 6194 tablet_replica.cc:442] T 825cf56da745436a9cf3002cd80461ae P b98b43a3d9e94ba2818fa7d3d2b0f59f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260618 23:19:38.554930 6193 raft_consensus.cc:482] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:19:38.555028 6193 raft_consensus.cc:504] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:38.555418 6193 leader_election.cc:288] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98b43a3d9e94ba2818fa7d3d2b0f59f (127.3.217.130:33013), c7ac1a31326d41578dd4829e82e2f97b (127.3.217.131:45473)
I20260618 23:19:38.558364 6183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.555779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:51679 (local address 127.3.217.131:45473)
0618 23:19:38.555874 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:38.555876 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:38.555887 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:19:38.555980 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:38.555982 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:38.555991 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:38.556046 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:38.556222 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.556701 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.557635 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.558007 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.558089 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.558098 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:38.558263 (+ 165us) server_negotiation.cc:299] Negotiation successful
0618 23:19:38.558296 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260618 23:19:38.558566 6208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.555710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:45473 (local address 127.3.217.129:51679)
0618 23:19:38.555832 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:38.555844 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:38.555896 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:38.556047 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:38.556048 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:38.556049 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:38.556130 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.556132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.556789 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.556790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.557537 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.557539 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.558118 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.558119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.558186 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.558189 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:19:38.558256 (+ 67us) client_negotiation.cc:240] Negotiation successful
0618 23:19:38.558296 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":57,"threads_started":1}
I20260618 23:19:38.558781 6184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.555638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:33279 (local address 127.3.217.130:33013)
0618 23:19:38.555713 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:38.555716 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:38.555905 (+ 189us) server_negotiation.cc:407] Connection header received
0618 23:19:38.555933 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:38.555934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:38.555944 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:38.556246 (+ 302us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:38.556468 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.556982 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.557974 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.558357 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.558459 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.558466 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:38.558633 (+ 167us) server_negotiation.cc:299] Negotiation successful
0618 23:19:38.558673 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260618 23:19:38.558883 6117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "825cf56da745436a9cf3002cd80461ae" candidate_uuid: "567aad74196e41e58e3f38882cdd0cc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7ac1a31326d41578dd4829e82e2f97b" is_pre_election: true
I20260618 23:19:38.559003 6117 raft_consensus.cc:2454] T 825cf56da745436a9cf3002cd80461ae P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567aad74196e41e58e3f38882cdd0cc3 in term 0.
I20260618 23:19:38.559027 6207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.555591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:33013 (local address 127.3.217.129:33279)
0618 23:19:38.555737 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:38.555748 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:38.555875 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:38.556253 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:38.556254 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:38.556256 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:38.556365 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.556367 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.557074 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.557075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.557864 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.557866 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.558463 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.558464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.558544 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.558548 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:19:38.558873 (+ 325us) client_negotiation.cc:240] Negotiation successful
0618 23:19:38.558924 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":76,"threads_started":1}
I20260618 23:19:38.559221 5770 leader_election.cc:302] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567aad74196e41e58e3f38882cdd0cc3, c7ac1a31326d41578dd4829e82e2f97b; no voters:
I20260618 23:19:38.559303 5977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "825cf56da745436a9cf3002cd80461ae" candidate_uuid: "567aad74196e41e58e3f38882cdd0cc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" is_pre_election: true
I20260618 23:19:38.559352 6193 raft_consensus.cc:2781] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:19:38.559391 6193 raft_consensus.cc:482] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:19:38.559394 5977 raft_consensus.cc:2454] T 825cf56da745436a9cf3002cd80461ae P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567aad74196e41e58e3f38882cdd0cc3 in term 0.
I20260618 23:19:38.559417 6193 raft_consensus.cc:3037] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:38.560148 6193 raft_consensus.cc:504] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:38.560309 6193 leader_election.cc:288] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3 [CANDIDATE]: Term 1 election: Requested vote from peers b98b43a3d9e94ba2818fa7d3d2b0f59f (127.3.217.130:33013), c7ac1a31326d41578dd4829e82e2f97b (127.3.217.131:45473)
I20260618 23:19:38.560438 6117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "825cf56da745436a9cf3002cd80461ae" candidate_uuid: "567aad74196e41e58e3f38882cdd0cc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7ac1a31326d41578dd4829e82e2f97b"
I20260618 23:19:38.560621 6117 raft_consensus.cc:3037] T 825cf56da745436a9cf3002cd80461ae P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:38.560535 5977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "825cf56da745436a9cf3002cd80461ae" candidate_uuid: "567aad74196e41e58e3f38882cdd0cc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f"
I20260618 23:19:38.560683 5977 raft_consensus.cc:3037] T 825cf56da745436a9cf3002cd80461ae P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:38.561404 6117 raft_consensus.cc:2454] T 825cf56da745436a9cf3002cd80461ae P c7ac1a31326d41578dd4829e82e2f97b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567aad74196e41e58e3f38882cdd0cc3 in term 1.
I20260618 23:19:38.561404 5977 raft_consensus.cc:2454] T 825cf56da745436a9cf3002cd80461ae P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567aad74196e41e58e3f38882cdd0cc3 in term 1.
I20260618 23:19:38.561686 5771 leader_election.cc:302] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567aad74196e41e58e3f38882cdd0cc3, b98b43a3d9e94ba2818fa7d3d2b0f59f; no voters:
I20260618 23:19:38.561798 6193 raft_consensus.cc:2781] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:38.561918 6193 raft_consensus.cc:686] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3 [term 1 LEADER]: Becoming Leader. State: Replica: 567aad74196e41e58e3f38882cdd0cc3, State: Running, Role: LEADER
I20260618 23:19:38.562032 6193 consensus_queue.cc:237] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:38.562568 6209 tablet_replica.cc:439] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3: TxnStatusTablet state changed. Reason: New leader 567aad74196e41e58e3f38882cdd0cc3. Latest consensus state: current_term: 1 leader_uuid: "567aad74196e41e58e3f38882cdd0cc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } } }
I20260618 23:19:38.562654 6209 tablet_replica.cc:442] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3: This TxnStatusTablet replica's current role is: LEADER
I20260618 23:19:38.563079 5680 catalog_manager.cc:5495] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 567aad74196e41e58e3f38882cdd0cc3 (127.3.217.129). New cstate: current_term: 1 leader_uuid: "567aad74196e41e58e3f38882cdd0cc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260618 23:19:38.563030 6211 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260618 23:19:38.563331 6211 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260618 23:19:38.614473 6185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.611238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47522 (local address 127.3.217.129:39407)
0618 23:19:38.611312 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:38.611315 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:38.611325 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:19:38.611400 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:38.611401 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:38.611422 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:38.611502 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:19:38.611605 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.612368 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.613357 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.613662 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.613734 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.613923 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:19:38.614051 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:19:38.614139 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:38.614365 (+ 226us) server_negotiation.cc:299] Negotiation successful
0618 23:19:38.614386 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260618 23:19:38.614542 6203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.611161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:39407 (local address 127.0.0.1:47522)
0618 23:19:38.611267 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:38.611280 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:38.611332 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:38.611501 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:38.611501 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:38.611502 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0618 23:19:38.611546 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.611548 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.612554 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.612556 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.613260 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.613263 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.613747 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.613748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.613803 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.613818 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0618 23:19:38.614227 (+ 409us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0618 23:19:38.614248 (+ 21us) client_negotiation.cc:769] Sending connection context
0618 23:19:38.614331 (+ 83us) client_negotiation.cc:240] Negotiation successful
0618 23:19:38.614388 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260618 23:19:38.616775 5977 raft_consensus.cc:1261] T 825cf56da745436a9cf3002cd80461ae P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 1 FOLLOWER]: Refusing update from remote peer 567aad74196e41e58e3f38882cdd0cc3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:19:38.616750 6117 raft_consensus.cc:1261] T 825cf56da745436a9cf3002cd80461ae P c7ac1a31326d41578dd4829e82e2f97b [term 1 FOLLOWER]: Refusing update from remote peer 567aad74196e41e58e3f38882cdd0cc3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:19:38.617149 6193 consensus_queue.cc:1035] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:19:38.617349 6209 consensus_queue.cc:1035] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:19:38.618499 6192 tablet_replica.cc:439] T 825cf56da745436a9cf3002cd80461ae P c7ac1a31326d41578dd4829e82e2f97b: TxnStatusTablet state changed. Reason: New leader 567aad74196e41e58e3f38882cdd0cc3. Latest consensus state: current_term: 1 leader_uuid: "567aad74196e41e58e3f38882cdd0cc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } } }
I20260618 23:19:38.618582 6192 tablet_replica.cc:442] T 825cf56da745436a9cf3002cd80461ae P c7ac1a31326d41578dd4829e82e2f97b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260618 23:19:38.618531 6194 tablet_replica.cc:439] T 825cf56da745436a9cf3002cd80461ae P b98b43a3d9e94ba2818fa7d3d2b0f59f: TxnStatusTablet state changed. Reason: New leader 567aad74196e41e58e3f38882cdd0cc3. Latest consensus state: current_term: 1 leader_uuid: "567aad74196e41e58e3f38882cdd0cc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } } }
I20260618 23:19:38.618610 6194 tablet_replica.cc:442] T 825cf56da745436a9cf3002cd80461ae P b98b43a3d9e94ba2818fa7d3d2b0f59f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260618 23:19:38.619845 6209 tablet_replica.cc:439] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "567aad74196e41e58e3f38882cdd0cc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } } }
I20260618 23:19:38.619925 6209 tablet_replica.cc:442] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3: This TxnStatusTablet replica's current role is: LEADER
I20260618 23:19:38.620019 6209 tablet_replica.cc:439] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "567aad74196e41e58e3f38882cdd0cc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } } }
I20260618 23:19:38.620078 6209 tablet_replica.cc:442] T 825cf56da745436a9cf3002cd80461ae P 567aad74196e41e58e3f38882cdd0cc3: This TxnStatusTablet replica's current role is: LEADER
I20260618 23:19:38.620152 6194 tablet_replica.cc:439] T 825cf56da745436a9cf3002cd80461ae P b98b43a3d9e94ba2818fa7d3d2b0f59f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "567aad74196e41e58e3f38882cdd0cc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } } }
I20260618 23:19:38.620237 6194 tablet_replica.cc:442] T 825cf56da745436a9cf3002cd80461ae P b98b43a3d9e94ba2818fa7d3d2b0f59f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260618 23:19:38.620491 6216 mvcc.cc:205] Tried to move back new op lower bound from 7298354293211471872 to 7298354292990853120. Current Snapshot: MvccSnapshot[applied={T|T < 7298354293211471872}]
I20260618 23:19:38.620616 6215 mvcc.cc:205] Tried to move back new op lower bound from 7298354293211471872 to 7298354292990853120. Current Snapshot: MvccSnapshot[applied={T|T < 7298354293211471872}]
I20260618 23:19:38.620582 6192 tablet_replica.cc:439] T 825cf56da745436a9cf3002cd80461ae P c7ac1a31326d41578dd4829e82e2f97b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "567aad74196e41e58e3f38882cdd0cc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } } }
I20260618 23:19:38.620739 6192 tablet_replica.cc:442] T 825cf56da745436a9cf3002cd80461ae P c7ac1a31326d41578dd4829e82e2f97b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260618 23:19:38.625711 6183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.622730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44662 (local address 127.3.217.131:45473)
0618 23:19:38.622766 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:38.622768 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:38.622779 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:19:38.622811 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:38.622812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:38.622827 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:38.622893 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:19:38.623036 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.623496 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.624580 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.624794 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.624880 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.625235 (+ 355us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:19:38.625371 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:19:38.625561 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:38.625607 (+ 46us) server_negotiation.cc:299] Negotiation successful
0618 23:19:38.625637 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260618 23:19:38.631954 6185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.628748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:35261 (local address 127.3.217.129:39407)
0618 23:19:38.628797 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:38.628799 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:38.628899 (+ 100us) server_negotiation.cc:407] Connection header received
0618 23:19:38.628984 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:38.628984 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:38.628991 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:38.629036 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:19:38.629289 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.629887 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.631174 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.631418 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.631488 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.631715 (+ 227us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:19:38.631740 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:19:38.631778 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:38.631876 (+ 98us) server_negotiation.cc:299] Negotiation successful
0618 23:19:38.631900 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260618 23:19:38.632018 6225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.628640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:39407 (local address 127.3.217.131:35261)
0618 23:19:38.628832 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:38.628845 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:38.628919 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:38.629042 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:38.629043 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:38.629045 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0618 23:19:38.629106 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.629107 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.630009 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.630010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.631060 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.631063 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.631515 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.631516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.631592 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.631608 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0618 23:19:38.631812 (+ 204us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0618 23:19:38.631814 (+ 2us) client_negotiation.cc:769] Sending connection context
0618 23:19:38.631876 (+ 62us) client_negotiation.cc:240] Negotiation successful
0618 23:19:38.631924 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":88,"threads_started":1}
I20260618 23:19:38.634689 5977 raft_consensus.cc:1261] T 16ab01e9357a4ad2b257aacd021652b7 P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 1 FOLLOWER]: Refusing update from remote peer c7ac1a31326d41578dd4829e82e2f97b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:19:38.634791 5837 raft_consensus.cc:1261] T 16ab01e9357a4ad2b257aacd021652b7 P 567aad74196e41e58e3f38882cdd0cc3 [term 1 FOLLOWER]: Refusing update from remote peer c7ac1a31326d41578dd4829e82e2f97b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:19:38.634968 6196 consensus_queue.cc:1035] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:19:38.635095 6192 consensus_queue.cc:1035] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b [LEADER]: Connected to new peer: Peer: permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:19:38.643482 6183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.640929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:43307 (local address 127.3.217.131:45473)
0618 23:19:38.640961 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:38.640963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:38.640975 (+ 12us) server_negotiation.cc:407] Connection header received
0618 23:19:38.641052 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:38.641053 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:38.641062 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:38.641108 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:19:38.641295 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.641772 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.642758 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.642961 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.643044 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.643220 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:19:38.643250 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:19:38.643321 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:38.643388 (+ 67us) server_negotiation.cc:299] Negotiation successful
0618 23:19:38.643406 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260618 23:19:38.643546 6232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:38.640740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:45473 (local address 127.3.217.129:43307)
0618 23:19:38.640926 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:38.640938 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:38.640991 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:38.641152 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:38.641153 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:38.641154 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0618 23:19:38.641217 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.641219 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.641877 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.641884 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.642665 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:38.642667 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:38.643045 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:38.643045 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:38.643107 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:38.643122 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0618 23:19:38.643324 (+ 202us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0618 23:19:38.643326 (+ 2us) client_negotiation.cc:769] Sending connection context
0618 23:19:38.643377 (+ 51us) client_negotiation.cc:240] Negotiation successful
0618 23:19:38.643419 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":85,"threads_started":1}
I20260618 23:19:38.652845 5679 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39200:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:19:38.652971 5679 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39200:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:19:38.653738 5679 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2: Sending DeleteTablet for 3 replicas of tablet 16ab01e9357a4ad2b257aacd021652b7
I20260618 23:19:38.654084 6097 tablet_service.cc:1514] Processing DeleteTablet for tablet 16ab01e9357a4ad2b257aacd021652b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:38 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:44646
I20260618 23:19:38.654107 5817 tablet_service.cc:1514] Processing DeleteTablet for tablet 16ab01e9357a4ad2b257aacd021652b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:38 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:47518
I20260618 23:19:38.654336 5957 tablet_service.cc:1514] Processing DeleteTablet for tablet 16ab01e9357a4ad2b257aacd021652b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:38 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:53498
I20260618 23:19:38.654490 6236 tablet_replica.cc:330] T 16ab01e9357a4ad2b257aacd021652b7 P 567aad74196e41e58e3f38882cdd0cc3: stopping tablet replica
I20260618 23:19:38.654624 6236 raft_consensus.cc:2229] T 16ab01e9357a4ad2b257aacd021652b7 P 567aad74196e41e58e3f38882cdd0cc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:19:38.654753 6236 raft_consensus.cc:2258] T 16ab01e9357a4ad2b257aacd021652b7 P 567aad74196e41e58e3f38882cdd0cc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:38.654801 5679 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39200:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:19:38.654943 5679 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:19:38.655342 6235 tablet_replica.cc:330] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b: stopping tablet replica
I20260618 23:19:38.655453 6235 raft_consensus.cc:2229] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:19:38.655539 6235 raft_consensus.cc:2258] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:38.656001 6236 ts_tablet_manager.cc:1905] T 16ab01e9357a4ad2b257aacd021652b7 P 567aad74196e41e58e3f38882cdd0cc3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:19:38.656518 5957 tablet_service.cc:1467] Processing CreateTablet for tablet 7a444a08292544e493f2a45fc333c62a (DEFAULT_TABLE table=test-table [id=93add8e122e240a393e52f9840bdf1bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:38.656648 5957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a444a08292544e493f2a45fc333c62a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:38.658074 6097 tablet_service.cc:1467] Processing CreateTablet for tablet 7a444a08292544e493f2a45fc333c62a (DEFAULT_TABLE table=test-table [id=93add8e122e240a393e52f9840bdf1bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:38.658192 6097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a444a08292544e493f2a45fc333c62a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:38.658463 6236 ts_tablet_manager.cc:1918] T 16ab01e9357a4ad2b257aacd021652b7 P 567aad74196e41e58e3f38882cdd0cc3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260618 23:19:38.658572 6236 log.cc:1196] T 16ab01e9357a4ad2b257aacd021652b7 P 567aad74196e41e58e3f38882cdd0cc3: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-0/wal/wals/16ab01e9357a4ad2b257aacd021652b7
I20260618 23:19:38.658964 6236 ts_tablet_manager.cc:1939] T 16ab01e9357a4ad2b257aacd021652b7 P 567aad74196e41e58e3f38882cdd0cc3: Deleting consensus metadata
I20260618 23:19:38.659580 6186 tablet_bootstrap.cc:492] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b: Bootstrap starting.
I20260618 23:19:38.659586 6188 tablet_bootstrap.cc:492] T 7a444a08292544e493f2a45fc333c62a P b98b43a3d9e94ba2818fa7d3d2b0f59f: Bootstrap starting.
I20260618 23:19:38.659969 6188 tablet_bootstrap.cc:654] T 7a444a08292544e493f2a45fc333c62a P b98b43a3d9e94ba2818fa7d3d2b0f59f: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:38.660012 6186 tablet_bootstrap.cc:654] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:38.660674 5665 catalog_manager.cc:4841] TS 567aad74196e41e58e3f38882cdd0cc3 (127.3.217.129:39407): tablet 16ab01e9357a4ad2b257aacd021652b7 (table test-table [id=7c2d922bffe445f0a7a50b5b5f820c2a]) successfully deleted
I20260618 23:19:38.660758 5817 tablet_service.cc:1467] Processing CreateTablet for tablet 7a444a08292544e493f2a45fc333c62a (DEFAULT_TABLE table=test-table [id=93add8e122e240a393e52f9840bdf1bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:38.660854 5817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a444a08292544e493f2a45fc333c62a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:38.661090 6235 ts_tablet_manager.cc:1905] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:19:38.662026 6187 tablet_bootstrap.cc:492] T 7a444a08292544e493f2a45fc333c62a P 567aad74196e41e58e3f38882cdd0cc3: Bootstrap starting.
I20260618 23:19:38.662289 6237 tablet_replica.cc:330] T 16ab01e9357a4ad2b257aacd021652b7 P b98b43a3d9e94ba2818fa7d3d2b0f59f: stopping tablet replica
I20260618 23:19:38.662393 6187 tablet_bootstrap.cc:654] T 7a444a08292544e493f2a45fc333c62a P 567aad74196e41e58e3f38882cdd0cc3: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:38.662400 6237 raft_consensus.cc:2229] T 16ab01e9357a4ad2b257aacd021652b7 P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:19:38.662460 6237 raft_consensus.cc:2258] T 16ab01e9357a4ad2b257aacd021652b7 P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:38.662920 6237 ts_tablet_manager.cc:1905] T 16ab01e9357a4ad2b257aacd021652b7 P b98b43a3d9e94ba2818fa7d3d2b0f59f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:19:38.663117 6235 ts_tablet_manager.cc:1918] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260618 23:19:38.663228 6235 log.cc:1196] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/16ab01e9357a4ad2b257aacd021652b7
I20260618 23:19:38.663259 6188 tablet_bootstrap.cc:492] T 7a444a08292544e493f2a45fc333c62a P b98b43a3d9e94ba2818fa7d3d2b0f59f: No bootstrap required, opened a new log
I20260618 23:19:38.663317 6188 ts_tablet_manager.cc:1397] T 7a444a08292544e493f2a45fc333c62a P b98b43a3d9e94ba2818fa7d3d2b0f59f: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260618 23:19:38.663475 6188 raft_consensus.cc:348] T 7a444a08292544e493f2a45fc333c62a P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:38.663545 6188 raft_consensus.cc:374] T 7a444a08292544e493f2a45fc333c62a P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:38.663573 6188 raft_consensus.cc:729] T 7a444a08292544e493f2a45fc333c62a P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98b43a3d9e94ba2818fa7d3d2b0f59f, State: Initialized, Role: FOLLOWER
I20260618 23:19:38.663612 6188 consensus_queue.cc:260] T 7a444a08292544e493f2a45fc333c62a P b98b43a3d9e94ba2818fa7d3d2b0f59f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:38.663718 6188 ts_tablet_manager.cc:1428] T 7a444a08292544e493f2a45fc333c62a P b98b43a3d9e94ba2818fa7d3d2b0f59f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260618 23:19:38.663853 6235 ts_tablet_manager.cc:1939] T 16ab01e9357a4ad2b257aacd021652b7 P c7ac1a31326d41578dd4829e82e2f97b: Deleting consensus metadata
I20260618 23:19:38.664892 5666 catalog_manager.cc:4841] TS c7ac1a31326d41578dd4829e82e2f97b (127.3.217.131:45473): tablet 16ab01e9357a4ad2b257aacd021652b7 (table test-table [id=7c2d922bffe445f0a7a50b5b5f820c2a]) successfully deleted
I20260618 23:19:38.665105 6187 tablet_bootstrap.cc:492] T 7a444a08292544e493f2a45fc333c62a P 567aad74196e41e58e3f38882cdd0cc3: No bootstrap required, opened a new log
I20260618 23:19:38.665171 6187 ts_tablet_manager.cc:1397] T 7a444a08292544e493f2a45fc333c62a P 567aad74196e41e58e3f38882cdd0cc3: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260618 23:19:38.665314 6187 raft_consensus.cc:348] T 7a444a08292544e493f2a45fc333c62a P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:38.665392 6187 raft_consensus.cc:374] T 7a444a08292544e493f2a45fc333c62a P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:38.665414 6187 raft_consensus.cc:729] T 7a444a08292544e493f2a45fc333c62a P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567aad74196e41e58e3f38882cdd0cc3, State: Initialized, Role: FOLLOWER
I20260618 23:19:38.665464 6187 consensus_queue.cc:260] T 7a444a08292544e493f2a45fc333c62a P 567aad74196e41e58e3f38882cdd0cc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:38.665555 6187 ts_tablet_manager.cc:1428] T 7a444a08292544e493f2a45fc333c62a P 567aad74196e41e58e3f38882cdd0cc3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260618 23:19:38.665931 6186 tablet_bootstrap.cc:492] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b: No bootstrap required, opened a new log
I20260618 23:19:38.666043 6186 ts_tablet_manager.cc:1397] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260618 23:19:38.666193 6186 raft_consensus.cc:348] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:38.666281 6186 raft_consensus.cc:374] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:38.666303 6186 raft_consensus.cc:729] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7ac1a31326d41578dd4829e82e2f97b, State: Initialized, Role: FOLLOWER
I20260618 23:19:38.666344 6186 consensus_queue.cc:260] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:38.666424 6186 ts_tablet_manager.cc:1428] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260618 23:19:38.670854 6237 ts_tablet_manager.cc:1918] T 16ab01e9357a4ad2b257aacd021652b7 P b98b43a3d9e94ba2818fa7d3d2b0f59f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260618 23:19:38.670949 6237 log.cc:1196] T 16ab01e9357a4ad2b257aacd021652b7 P b98b43a3d9e94ba2818fa7d3d2b0f59f: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/16ab01e9357a4ad2b257aacd021652b7
I20260618 23:19:38.671239 6237 ts_tablet_manager.cc:1939] T 16ab01e9357a4ad2b257aacd021652b7 P b98b43a3d9e94ba2818fa7d3d2b0f59f: Deleting consensus metadata
I20260618 23:19:38.671717 5667 catalog_manager.cc:4841] TS b98b43a3d9e94ba2818fa7d3d2b0f59f (127.3.217.130:33013): tablet 16ab01e9357a4ad2b257aacd021652b7 (table test-table [id=7c2d922bffe445f0a7a50b5b5f820c2a]) successfully deleted
I20260618 23:19:38.871554 6229 raft_consensus.cc:482] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:19:38.871809 6229 raft_consensus.cc:504] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:38.872030 6229 leader_election.cc:288] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 567aad74196e41e58e3f38882cdd0cc3 (127.3.217.129:39407), b98b43a3d9e94ba2818fa7d3d2b0f59f (127.3.217.130:33013)
I20260618 23:19:38.872269 5837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a444a08292544e493f2a45fc333c62a" candidate_uuid: "c7ac1a31326d41578dd4829e82e2f97b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567aad74196e41e58e3f38882cdd0cc3" is_pre_election: true
I20260618 23:19:38.872373 5837 raft_consensus.cc:2454] T 7a444a08292544e493f2a45fc333c62a P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7ac1a31326d41578dd4829e82e2f97b in term 0.
I20260618 23:19:38.872318 5976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a444a08292544e493f2a45fc333c62a" candidate_uuid: "c7ac1a31326d41578dd4829e82e2f97b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" is_pre_election: true
I20260618 23:19:38.872438 5976 raft_consensus.cc:2454] T 7a444a08292544e493f2a45fc333c62a P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7ac1a31326d41578dd4829e82e2f97b in term 0.
I20260618 23:19:38.872624 6051 leader_election.cc:302] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98b43a3d9e94ba2818fa7d3d2b0f59f, c7ac1a31326d41578dd4829e82e2f97b; no voters:
I20260618 23:19:38.872706 6229 raft_consensus.cc:2781] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:19:38.872738 6229 raft_consensus.cc:482] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:19:38.872771 6229 raft_consensus.cc:3037] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:38.873471 6229 raft_consensus.cc:504] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:38.873613 6229 leader_election.cc:288] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b [CANDIDATE]: Term 1 election: Requested vote from peers 567aad74196e41e58e3f38882cdd0cc3 (127.3.217.129:39407), b98b43a3d9e94ba2818fa7d3d2b0f59f (127.3.217.130:33013)
I20260618 23:19:38.873771 5837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a444a08292544e493f2a45fc333c62a" candidate_uuid: "c7ac1a31326d41578dd4829e82e2f97b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567aad74196e41e58e3f38882cdd0cc3"
I20260618 23:19:38.873771 5976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a444a08292544e493f2a45fc333c62a" candidate_uuid: "c7ac1a31326d41578dd4829e82e2f97b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f"
I20260618 23:19:38.873859 5837 raft_consensus.cc:3037] T 7a444a08292544e493f2a45fc333c62a P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:38.873885 5976 raft_consensus.cc:3037] T 7a444a08292544e493f2a45fc333c62a P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:38.874655 5976 raft_consensus.cc:2454] T 7a444a08292544e493f2a45fc333c62a P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7ac1a31326d41578dd4829e82e2f97b in term 1.
I20260618 23:19:38.874655 5837 raft_consensus.cc:2454] T 7a444a08292544e493f2a45fc333c62a P 567aad74196e41e58e3f38882cdd0cc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7ac1a31326d41578dd4829e82e2f97b in term 1.
I20260618 23:19:38.874858 6049 leader_election.cc:302] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567aad74196e41e58e3f38882cdd0cc3, c7ac1a31326d41578dd4829e82e2f97b; no voters:
I20260618 23:19:38.874958 6229 raft_consensus.cc:2781] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:38.875017 6229 raft_consensus.cc:686] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b [term 1 LEADER]: Becoming Leader. State: Replica: c7ac1a31326d41578dd4829e82e2f97b, State: Running, Role: LEADER
I20260618 23:19:38.875070 6229 consensus_queue.cc:237] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:38.875665 5679 catalog_manager.cc:5495] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7ac1a31326d41578dd4829e82e2f97b (127.3.217.131). New cstate: current_term: 1 leader_uuid: "c7ac1a31326d41578dd4829e82e2f97b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260618 23:19:38.897104 5976 raft_consensus.cc:1261] T 7a444a08292544e493f2a45fc333c62a P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 1 FOLLOWER]: Refusing update from remote peer c7ac1a31326d41578dd4829e82e2f97b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:19:38.897115 5837 raft_consensus.cc:1261] T 7a444a08292544e493f2a45fc333c62a P 567aad74196e41e58e3f38882cdd0cc3 [term 1 FOLLOWER]: Refusing update from remote peer c7ac1a31326d41578dd4829e82e2f97b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:19:38.897331 6230 consensus_queue.cc:1035] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:19:38.897433 6229 consensus_queue.cc:1035] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b [LEADER]: Connected to new peer: Peer: permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:19:38.898895 6214 mvcc.cc:205] Tried to move back new op lower bound from 7298354294361092096 to 7298354294272708608. Current Snapshot: MvccSnapshot[applied={T|T < 7298354294361092096}]
W20260618 23:19:38.901844 6215 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260618 23:19:40.422020 5680 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39200:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:19:40.422185 5680 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39200:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:19:40.423256 5680 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2: Sending DeleteTablet for 3 replicas of tablet 7a444a08292544e493f2a45fc333c62a
I20260618 23:19:40.423552 6097 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a444a08292544e493f2a45fc333c62a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:40 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:44646
I20260618 23:19:40.423563 5957 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a444a08292544e493f2a45fc333c62a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:40 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:53498
I20260618 23:19:40.423729 5817 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a444a08292544e493f2a45fc333c62a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:40 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:47518
I20260618 23:19:40.423921 6268 tablet_replica.cc:330] T 7a444a08292544e493f2a45fc333c62a P 567aad74196e41e58e3f38882cdd0cc3: stopping tablet replica
I20260618 23:19:40.423996 6268 raft_consensus.cc:2229] T 7a444a08292544e493f2a45fc333c62a P 567aad74196e41e58e3f38882cdd0cc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:19:40.424039 6268 raft_consensus.cc:2258] T 7a444a08292544e493f2a45fc333c62a P 567aad74196e41e58e3f38882cdd0cc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:40.425423 6266 tablet_replica.cc:330] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b: stopping tablet replica
I20260618 23:19:40.425501 6266 raft_consensus.cc:2229] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:19:40.425572 6266 raft_consensus.cc:2258] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:40.425879 6266 ts_tablet_manager.cc:1905] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:19:40.426031 6268 ts_tablet_manager.cc:1905] T 7a444a08292544e493f2a45fc333c62a P 567aad74196e41e58e3f38882cdd0cc3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:19:40.426832 6267 tablet_replica.cc:330] T 7a444a08292544e493f2a45fc333c62a P b98b43a3d9e94ba2818fa7d3d2b0f59f: stopping tablet replica
I20260618 23:19:40.426904 6267 raft_consensus.cc:2229] T 7a444a08292544e493f2a45fc333c62a P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:19:40.426949 6267 raft_consensus.cc:2258] T 7a444a08292544e493f2a45fc333c62a P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:40.427157 6267 ts_tablet_manager.cc:1905] T 7a444a08292544e493f2a45fc333c62a P b98b43a3d9e94ba2818fa7d3d2b0f59f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:19:40.427503 6266 ts_tablet_manager.cc:1918] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260618 23:19:40.427706 6268 ts_tablet_manager.cc:1918] T 7a444a08292544e493f2a45fc333c62a P 567aad74196e41e58e3f38882cdd0cc3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260618 23:19:40.427770 6268 log.cc:1196] T 7a444a08292544e493f2a45fc333c62a P 567aad74196e41e58e3f38882cdd0cc3: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-0/wal/wals/7a444a08292544e493f2a45fc333c62a
I20260618 23:19:40.428020 6268 ts_tablet_manager.cc:1939] T 7a444a08292544e493f2a45fc333c62a P 567aad74196e41e58e3f38882cdd0cc3: Deleting consensus metadata
I20260618 23:19:40.428344 5665 catalog_manager.cc:4841] TS 567aad74196e41e58e3f38882cdd0cc3 (127.3.217.129:39407): tablet 7a444a08292544e493f2a45fc333c62a (table test-table [id=93add8e122e240a393e52f9840bdf1bb]) successfully deleted
I20260618 23:19:40.428817 6267 ts_tablet_manager.cc:1918] T 7a444a08292544e493f2a45fc333c62a P b98b43a3d9e94ba2818fa7d3d2b0f59f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260618 23:19:40.428917 6267 log.cc:1196] T 7a444a08292544e493f2a45fc333c62a P b98b43a3d9e94ba2818fa7d3d2b0f59f: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/7a444a08292544e493f2a45fc333c62a
I20260618 23:19:40.429147 6267 ts_tablet_manager.cc:1939] T 7a444a08292544e493f2a45fc333c62a P b98b43a3d9e94ba2818fa7d3d2b0f59f: Deleting consensus metadata
I20260618 23:19:40.429453 5667 catalog_manager.cc:4841] TS b98b43a3d9e94ba2818fa7d3d2b0f59f (127.3.217.130:33013): tablet 7a444a08292544e493f2a45fc333c62a (table test-table [id=93add8e122e240a393e52f9840bdf1bb]) successfully deleted
I20260618 23:19:40.427567 6266 log.cc:1196] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/7a444a08292544e493f2a45fc333c62a
I20260618 23:19:40.430313 6266 ts_tablet_manager.cc:1939] T 7a444a08292544e493f2a45fc333c62a P c7ac1a31326d41578dd4829e82e2f97b: Deleting consensus metadata
I20260618 23:19:40.430615 5666 catalog_manager.cc:4841] TS c7ac1a31326d41578dd4829e82e2f97b (127.3.217.131:45473): tablet 7a444a08292544e493f2a45fc333c62a (table test-table [id=93add8e122e240a393e52f9840bdf1bb]) successfully deleted
Jun 18 23:19:40 dist-test-slave-r9ct krb5kdc[5635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824780, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 18 23:19:40 dist-test-slave-r9ct krb5kdc[5635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824780, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:40.454169 6276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:40.441415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39212 (local address 127.3.217.190:42963)
0618 23:19:40.441587 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:40.441588 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:40.441596 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:19:40.441632 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:40.441633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:40.441642 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:40.441694 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:40.442380 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.443076 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.444053 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.444293 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.444368 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:40.451106 (+ 6738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:40.451108 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:40.451108 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:40.451119 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:40.452771 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:40.453249 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:40.453250 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:40.453250 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:40.453308 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:40.453599 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:40.453600 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:40.453600 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:40.453724 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:40.453821 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:40.454024 (+ 203us) server_negotiation.cc:299] Negotiation successful
0618 23:19:40.454097 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":116,"threads_started":1}
I20260618 23:19:40.456223 5680 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39212:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:19:40.456373 5680 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:19:40.458103 5957 tablet_service.cc:1467] Processing CreateTablet for tablet eaed3a5ab6e444988ca0ab639b20465f (DEFAULT_TABLE table=test-table [id=2564cf3f01754214bbcd17538be0531b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:40.458132 5817 tablet_service.cc:1467] Processing CreateTablet for tablet eaed3a5ab6e444988ca0ab639b20465f (DEFAULT_TABLE table=test-table [id=2564cf3f01754214bbcd17538be0531b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:40.458240 5817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaed3a5ab6e444988ca0ab639b20465f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:40.458243 5957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaed3a5ab6e444988ca0ab639b20465f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:40.458215 6097 tablet_service.cc:1467] Processing CreateTablet for tablet eaed3a5ab6e444988ca0ab639b20465f (DEFAULT_TABLE table=test-table [id=2564cf3f01754214bbcd17538be0531b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:40.458343 6097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaed3a5ab6e444988ca0ab639b20465f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:40.459677 6278 tablet_bootstrap.cc:492] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3: Bootstrap starting.
I20260618 23:19:40.459717 6277 tablet_bootstrap.cc:492] T eaed3a5ab6e444988ca0ab639b20465f P c7ac1a31326d41578dd4829e82e2f97b: Bootstrap starting.
I20260618 23:19:40.460047 6277 tablet_bootstrap.cc:654] T eaed3a5ab6e444988ca0ab639b20465f P c7ac1a31326d41578dd4829e82e2f97b: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:40.460141 6278 tablet_bootstrap.cc:654] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:40.460460 6279 tablet_bootstrap.cc:492] T eaed3a5ab6e444988ca0ab639b20465f P b98b43a3d9e94ba2818fa7d3d2b0f59f: Bootstrap starting.
I20260618 23:19:40.460700 6277 tablet_bootstrap.cc:492] T eaed3a5ab6e444988ca0ab639b20465f P c7ac1a31326d41578dd4829e82e2f97b: No bootstrap required, opened a new log
I20260618 23:19:40.460741 6277 ts_tablet_manager.cc:1397] T eaed3a5ab6e444988ca0ab639b20465f P c7ac1a31326d41578dd4829e82e2f97b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:40.460813 6279 tablet_bootstrap.cc:654] T eaed3a5ab6e444988ca0ab639b20465f P b98b43a3d9e94ba2818fa7d3d2b0f59f: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:40.460851 6277 raft_consensus.cc:348] T eaed3a5ab6e444988ca0ab639b20465f P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:40.460930 6277 raft_consensus.cc:374] T eaed3a5ab6e444988ca0ab639b20465f P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:40.460953 6277 raft_consensus.cc:729] T eaed3a5ab6e444988ca0ab639b20465f P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7ac1a31326d41578dd4829e82e2f97b, State: Initialized, Role: FOLLOWER
I20260618 23:19:40.461021 6277 consensus_queue.cc:260] T eaed3a5ab6e444988ca0ab639b20465f P c7ac1a31326d41578dd4829e82e2f97b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:40.461122 6277 ts_tablet_manager.cc:1428] T eaed3a5ab6e444988ca0ab639b20465f P c7ac1a31326d41578dd4829e82e2f97b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:40.461171 6278 tablet_bootstrap.cc:492] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3: No bootstrap required, opened a new log
I20260618 23:19:40.461223 6278 ts_tablet_manager.cc:1397] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:19:40.461367 6278 raft_consensus.cc:348] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:40.461426 6278 raft_consensus.cc:374] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:40.461450 6278 raft_consensus.cc:729] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567aad74196e41e58e3f38882cdd0cc3, State: Initialized, Role: FOLLOWER
I20260618 23:19:40.461494 6278 consensus_queue.cc:260] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:40.461629 6278 ts_tablet_manager.cc:1428] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260618 23:19:40.462039 6279 tablet_bootstrap.cc:492] T eaed3a5ab6e444988ca0ab639b20465f P b98b43a3d9e94ba2818fa7d3d2b0f59f: No bootstrap required, opened a new log
I20260618 23:19:40.462105 6279 ts_tablet_manager.cc:1397] T eaed3a5ab6e444988ca0ab639b20465f P b98b43a3d9e94ba2818fa7d3d2b0f59f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:19:40.462245 6279 raft_consensus.cc:348] T eaed3a5ab6e444988ca0ab639b20465f P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:40.462317 6279 raft_consensus.cc:374] T eaed3a5ab6e444988ca0ab639b20465f P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:40.462339 6279 raft_consensus.cc:729] T eaed3a5ab6e444988ca0ab639b20465f P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98b43a3d9e94ba2818fa7d3d2b0f59f, State: Initialized, Role: FOLLOWER
I20260618 23:19:40.462383 6279 consensus_queue.cc:260] T eaed3a5ab6e444988ca0ab639b20465f P b98b43a3d9e94ba2818fa7d3d2b0f59f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:40.462543 6279 ts_tablet_manager.cc:1428] T eaed3a5ab6e444988ca0ab639b20465f P b98b43a3d9e94ba2818fa7d3d2b0f59f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260618 23:19:40.767802 6246 raft_consensus.cc:482] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:19:40.767947 6246 raft_consensus.cc:504] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:40.768193 6246 leader_election.cc:288] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98b43a3d9e94ba2818fa7d3d2b0f59f (127.3.217.130:33013), c7ac1a31326d41578dd4829e82e2f97b (127.3.217.131:45473)
I20260618 23:19:40.768482 5976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaed3a5ab6e444988ca0ab639b20465f" candidate_uuid: "567aad74196e41e58e3f38882cdd0cc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" is_pre_election: true
I20260618 23:19:40.768610 5976 raft_consensus.cc:2454] T eaed3a5ab6e444988ca0ab639b20465f P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567aad74196e41e58e3f38882cdd0cc3 in term 0.
I20260618 23:19:40.768507 6117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaed3a5ab6e444988ca0ab639b20465f" candidate_uuid: "567aad74196e41e58e3f38882cdd0cc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7ac1a31326d41578dd4829e82e2f97b" is_pre_election: true
I20260618 23:19:40.768671 6117 raft_consensus.cc:2454] T eaed3a5ab6e444988ca0ab639b20465f P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567aad74196e41e58e3f38882cdd0cc3 in term 0.
I20260618 23:19:40.768807 5771 leader_election.cc:302] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567aad74196e41e58e3f38882cdd0cc3, b98b43a3d9e94ba2818fa7d3d2b0f59f; no voters:
I20260618 23:19:40.768922 6246 raft_consensus.cc:2781] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:19:40.768956 6246 raft_consensus.cc:482] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:19:40.768986 6246 raft_consensus.cc:3037] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:40.770242 6246 raft_consensus.cc:504] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:40.770457 6246 leader_election.cc:288] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3 [CANDIDATE]: Term 1 election: Requested vote from peers b98b43a3d9e94ba2818fa7d3d2b0f59f (127.3.217.130:33013), c7ac1a31326d41578dd4829e82e2f97b (127.3.217.131:45473)
I20260618 23:19:40.770654 6117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaed3a5ab6e444988ca0ab639b20465f" candidate_uuid: "567aad74196e41e58e3f38882cdd0cc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7ac1a31326d41578dd4829e82e2f97b"
I20260618 23:19:40.770774 6117 raft_consensus.cc:3037] T eaed3a5ab6e444988ca0ab639b20465f P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:40.770809 5976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaed3a5ab6e444988ca0ab639b20465f" candidate_uuid: "567aad74196e41e58e3f38882cdd0cc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f"
I20260618 23:19:40.770887 5976 raft_consensus.cc:3037] T eaed3a5ab6e444988ca0ab639b20465f P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:40.771456 6117 raft_consensus.cc:2454] T eaed3a5ab6e444988ca0ab639b20465f P c7ac1a31326d41578dd4829e82e2f97b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567aad74196e41e58e3f38882cdd0cc3 in term 1.
I20260618 23:19:40.771746 5976 raft_consensus.cc:2454] T eaed3a5ab6e444988ca0ab639b20465f P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567aad74196e41e58e3f38882cdd0cc3 in term 1.
I20260618 23:19:40.771765 5770 leader_election.cc:302] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567aad74196e41e58e3f38882cdd0cc3, c7ac1a31326d41578dd4829e82e2f97b; no voters:
I20260618 23:19:40.771910 6246 raft_consensus.cc:2781] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:40.771967 6246 raft_consensus.cc:686] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3 [term 1 LEADER]: Becoming Leader. State: Replica: 567aad74196e41e58e3f38882cdd0cc3, State: Running, Role: LEADER
I20260618 23:19:40.772022 6246 consensus_queue.cc:237] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:40.772663 5679 catalog_manager.cc:5495] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 567aad74196e41e58e3f38882cdd0cc3 (127.3.217.129). New cstate: current_term: 1 leader_uuid: "567aad74196e41e58e3f38882cdd0cc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260618 23:19:40.819558 6286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:40.816665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47528 (local address 127.3.217.129:39407)
0618 23:19:40.816957 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:40.816960 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:40.816969 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:19:40.816990 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:40.816990 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:40.817001 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:40.817101 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:19:40.817273 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.817850 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.818673 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.818936 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.819015 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:40.819244 (+ 229us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:19:40.819292 (+ 48us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:19:40.819356 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:40.819423 (+ 67us) server_negotiation.cc:299] Negotiation successful
0618 23:19:40.819458 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":170,"threads_started":1}
I20260618 23:19:40.824308 6286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:40.822188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:54037 (local address 127.3.217.129:39407)
0618 23:19:40.822233 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:40.822235 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:40.822243 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:19:40.822330 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:40.822331 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:40.822342 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:40.822390 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:19:40.822493 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.822952 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.823654 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.823842 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.823913 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:40.824041 (+ 128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:19:40.824072 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:19:40.824126 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:40.824178 (+ 52us) server_negotiation.cc:299] Negotiation successful
0618 23:19:40.824217 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":17,"server-negotiator.queue_time_us":31}
I20260618 23:19:40.824316 6289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:40.822061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:39407 (local address 127.3.217.129:54037)
0618 23:19:40.822188 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:40.822198 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:40.822250 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:40.822399 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:40.822399 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:40.822401 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0618 23:19:40.822439 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:40.822440 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.823037 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.823038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:40.823575 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:40.823576 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.823912 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.823913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:40.823961 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:40.823969 (+ 8us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0618 23:19:40.824127 (+ 158us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0618 23:19:40.824129 (+ 2us) client_negotiation.cc:769] Sending connection context
0618 23:19:40.824176 (+ 47us) client_negotiation.cc:240] Negotiation successful
0618 23:19:40.824225 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"mutex_wait_us":2,"thread_start_us":81,"threads_started":1}
I20260618 23:19:40.826632 5976 raft_consensus.cc:1261] T eaed3a5ab6e444988ca0ab639b20465f P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 1 FOLLOWER]: Refusing update from remote peer 567aad74196e41e58e3f38882cdd0cc3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:19:40.826689 6117 raft_consensus.cc:1261] T eaed3a5ab6e444988ca0ab639b20465f P c7ac1a31326d41578dd4829e82e2f97b [term 1 FOLLOWER]: Refusing update from remote peer 567aad74196e41e58e3f38882cdd0cc3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:19:40.826889 6209 consensus_queue.cc:1035] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:19:40.827090 6209 consensus_queue.cc:1035] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:19:40.838449 5679 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:19:40.838649 5679 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:19:40.839398 5679 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2: Sending DeleteTablet for 3 replicas of tablet eaed3a5ab6e444988ca0ab639b20465f
I20260618 23:19:40.839668 6097 tablet_service.cc:1514] Processing DeleteTablet for tablet eaed3a5ab6e444988ca0ab639b20465f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:40 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:44646
I20260618 23:19:40.839735 5957 tablet_service.cc:1514] Processing DeleteTablet for tablet eaed3a5ab6e444988ca0ab639b20465f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:40 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:53498
I20260618 23:19:40.839907 6267 tablet_replica.cc:330] T eaed3a5ab6e444988ca0ab639b20465f P b98b43a3d9e94ba2818fa7d3d2b0f59f: stopping tablet replica
I20260618 23:19:40.839882 6266 tablet_replica.cc:330] T eaed3a5ab6e444988ca0ab639b20465f P c7ac1a31326d41578dd4829e82e2f97b: stopping tablet replica
I20260618 23:19:40.839982 6267 raft_consensus.cc:2229] T eaed3a5ab6e444988ca0ab639b20465f P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:19:40.840035 6267 raft_consensus.cc:2258] T eaed3a5ab6e444988ca0ab639b20465f P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:40.840019 6266 raft_consensus.cc:2229] T eaed3a5ab6e444988ca0ab639b20465f P c7ac1a31326d41578dd4829e82e2f97b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:19:40.840091 6266 raft_consensus.cc:2258] T eaed3a5ab6e444988ca0ab639b20465f P c7ac1a31326d41578dd4829e82e2f97b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:40.840368 5817 tablet_service.cc:1514] Processing DeleteTablet for tablet eaed3a5ab6e444988ca0ab639b20465f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:40 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:47518
I20260618 23:19:40.840572 6268 tablet_replica.cc:330] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3: stopping tablet replica
I20260618 23:19:40.840647 6268 raft_consensus.cc:2229] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3 [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:19:40.840727 6268 raft_consensus.cc:2258] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:40.840734 6266 ts_tablet_manager.cc:1905] T eaed3a5ab6e444988ca0ab639b20465f P c7ac1a31326d41578dd4829e82e2f97b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:19:40.840679 5679 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39212:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:19:40.840819 5679 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:19:40.841080 6268 ts_tablet_manager.cc:1905] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:19:40.841341 6267 ts_tablet_manager.cc:1905] T eaed3a5ab6e444988ca0ab639b20465f P b98b43a3d9e94ba2818fa7d3d2b0f59f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:19:40.842523 6266 ts_tablet_manager.cc:1918] T eaed3a5ab6e444988ca0ab639b20465f P c7ac1a31326d41578dd4829e82e2f97b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260618 23:19:40.842599 6266 log.cc:1196] T eaed3a5ab6e444988ca0ab639b20465f P c7ac1a31326d41578dd4829e82e2f97b: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/eaed3a5ab6e444988ca0ab639b20465f
I20260618 23:19:40.842871 6266 ts_tablet_manager.cc:1939] T eaed3a5ab6e444988ca0ab639b20465f P c7ac1a31326d41578dd4829e82e2f97b: Deleting consensus metadata
I20260618 23:19:40.843112 6267 ts_tablet_manager.cc:1918] T eaed3a5ab6e444988ca0ab639b20465f P b98b43a3d9e94ba2818fa7d3d2b0f59f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260618 23:19:40.843111 6097 tablet_service.cc:1467] Processing CreateTablet for tablet 6996ef88da3a4bf19ccf49aa19815978 (DEFAULT_TABLE table=test-table [id=cba2d565129b482f858be051b16c2f9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:40.843142 6268 ts_tablet_manager.cc:1918] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260618 23:19:40.843184 6267 log.cc:1196] T eaed3a5ab6e444988ca0ab639b20465f P b98b43a3d9e94ba2818fa7d3d2b0f59f: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/eaed3a5ab6e444988ca0ab639b20465f
I20260618 23:19:40.843190 6268 log.cc:1196] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-0/wal/wals/eaed3a5ab6e444988ca0ab639b20465f
I20260618 23:19:40.843211 6097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6996ef88da3a4bf19ccf49aa19815978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:40.843195 5817 tablet_service.cc:1467] Processing CreateTablet for tablet 6996ef88da3a4bf19ccf49aa19815978 (DEFAULT_TABLE table=test-table [id=cba2d565129b482f858be051b16c2f9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:40.843338 5817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6996ef88da3a4bf19ccf49aa19815978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:40.843410 6268 ts_tablet_manager.cc:1939] T eaed3a5ab6e444988ca0ab639b20465f P 567aad74196e41e58e3f38882cdd0cc3: Deleting consensus metadata
I20260618 23:19:40.843410 6267 ts_tablet_manager.cc:1939] T eaed3a5ab6e444988ca0ab639b20465f P b98b43a3d9e94ba2818fa7d3d2b0f59f: Deleting consensus metadata
I20260618 23:19:40.844403 6277 tablet_bootstrap.cc:492] T 6996ef88da3a4bf19ccf49aa19815978 P c7ac1a31326d41578dd4829e82e2f97b: Bootstrap starting.
I20260618 23:19:40.844470 5665 catalog_manager.cc:4841] TS 567aad74196e41e58e3f38882cdd0cc3 (127.3.217.129:39407): tablet eaed3a5ab6e444988ca0ab639b20465f (table test-table [id=2564cf3f01754214bbcd17538be0531b]) successfully deleted
I20260618 23:19:40.844550 5667 catalog_manager.cc:4841] TS b98b43a3d9e94ba2818fa7d3d2b0f59f (127.3.217.130:33013): tablet eaed3a5ab6e444988ca0ab639b20465f (table test-table [id=2564cf3f01754214bbcd17538be0531b]) successfully deleted
I20260618 23:19:40.844635 5957 tablet_service.cc:1467] Processing CreateTablet for tablet 6996ef88da3a4bf19ccf49aa19815978 (DEFAULT_TABLE table=test-table [id=cba2d565129b482f858be051b16c2f9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:40.844726 5957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6996ef88da3a4bf19ccf49aa19815978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:40.844779 6277 tablet_bootstrap.cc:654] T 6996ef88da3a4bf19ccf49aa19815978 P c7ac1a31326d41578dd4829e82e2f97b: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:40.845045 6278 tablet_bootstrap.cc:492] T 6996ef88da3a4bf19ccf49aa19815978 P 567aad74196e41e58e3f38882cdd0cc3: Bootstrap starting.
I20260618 23:19:40.845325 6278 tablet_bootstrap.cc:654] T 6996ef88da3a4bf19ccf49aa19815978 P 567aad74196e41e58e3f38882cdd0cc3: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:40.845321 6277 tablet_bootstrap.cc:492] T 6996ef88da3a4bf19ccf49aa19815978 P c7ac1a31326d41578dd4829e82e2f97b: No bootstrap required, opened a new log
I20260618 23:19:40.845407 6277 ts_tablet_manager.cc:1397] T 6996ef88da3a4bf19ccf49aa19815978 P c7ac1a31326d41578dd4829e82e2f97b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:40.845532 6277 raft_consensus.cc:348] T 6996ef88da3a4bf19ccf49aa19815978 P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:40.845593 6277 raft_consensus.cc:374] T 6996ef88da3a4bf19ccf49aa19815978 P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:40.845611 6277 raft_consensus.cc:729] T 6996ef88da3a4bf19ccf49aa19815978 P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7ac1a31326d41578dd4829e82e2f97b, State: Initialized, Role: FOLLOWER
I20260618 23:19:40.845659 6277 consensus_queue.cc:260] T 6996ef88da3a4bf19ccf49aa19815978 P c7ac1a31326d41578dd4829e82e2f97b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:40.845772 6277 ts_tablet_manager.cc:1428] T 6996ef88da3a4bf19ccf49aa19815978 P c7ac1a31326d41578dd4829e82e2f97b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:40.846001 6279 tablet_bootstrap.cc:492] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f: Bootstrap starting.
I20260618 23:19:40.846560 6279 tablet_bootstrap.cc:654] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:40.846904 5666 catalog_manager.cc:4841] TS c7ac1a31326d41578dd4829e82e2f97b (127.3.217.131:45473): tablet eaed3a5ab6e444988ca0ab639b20465f (table test-table [id=2564cf3f01754214bbcd17538be0531b]) successfully deleted
I20260618 23:19:40.847430 6279 tablet_bootstrap.cc:492] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f: No bootstrap required, opened a new log
I20260618 23:19:40.847481 6279 ts_tablet_manager.cc:1397] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:40.847612 6279 raft_consensus.cc:348] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:40.847677 6279 raft_consensus.cc:374] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:40.847704 6279 raft_consensus.cc:729] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98b43a3d9e94ba2818fa7d3d2b0f59f, State: Initialized, Role: FOLLOWER
I20260618 23:19:40.847746 6279 consensus_queue.cc:260] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:40.847844 6279 ts_tablet_manager.cc:1428] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:40.848237 6278 tablet_bootstrap.cc:492] T 6996ef88da3a4bf19ccf49aa19815978 P 567aad74196e41e58e3f38882cdd0cc3: No bootstrap required, opened a new log
I20260618 23:19:40.848291 6278 ts_tablet_manager.cc:1397] T 6996ef88da3a4bf19ccf49aa19815978 P 567aad74196e41e58e3f38882cdd0cc3: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260618 23:19:40.848412 6278 raft_consensus.cc:348] T 6996ef88da3a4bf19ccf49aa19815978 P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:40.848479 6278 raft_consensus.cc:374] T 6996ef88da3a4bf19ccf49aa19815978 P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:40.848498 6278 raft_consensus.cc:729] T 6996ef88da3a4bf19ccf49aa19815978 P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567aad74196e41e58e3f38882cdd0cc3, State: Initialized, Role: FOLLOWER
I20260618 23:19:40.848543 6278 consensus_queue.cc:260] T 6996ef88da3a4bf19ccf49aa19815978 P 567aad74196e41e58e3f38882cdd0cc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:40.848626 6278 ts_tablet_manager.cc:1428] T 6996ef88da3a4bf19ccf49aa19815978 P 567aad74196e41e58e3f38882cdd0cc3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:40.919389 6283 raft_consensus.cc:482] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:19:40.919502 6283 raft_consensus.cc:504] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:40.919870 6283 leader_election.cc:288] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 567aad74196e41e58e3f38882cdd0cc3 (127.3.217.129:39407), c7ac1a31326d41578dd4829e82e2f97b (127.3.217.131:45473)
I20260618 23:19:40.923146 6286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:40.920260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:42273 (local address 127.3.217.129:39407)
0618 23:19:40.920304 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:40.920306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:40.920315 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:19:40.920342 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:40.920343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:40.920351 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:40.920417 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:40.920598 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.921329 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.922342 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.922744 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.922895 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:40.922905 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:40.923038 (+ 133us) server_negotiation.cc:299] Negotiation successful
0618 23:19:40.923073 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260618 23:19:40.923182 6296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:40.920053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:39407 (local address 127.3.217.130:42273)
0618 23:19:40.920166 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:40.920179 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:40.920240 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:40.920430 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:40.920431 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:40.920433 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:40.920517 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:40.920519 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.921403 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.921404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:40.922228 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:40.922230 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.922893 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.922894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:40.922964 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:40.922967 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:19:40.923032 (+ 65us) client_negotiation.cc:240] Negotiation successful
0618 23:19:40.923072 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":74,"threads_started":1}
I20260618 23:19:40.923622 5837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6996ef88da3a4bf19ccf49aa19815978" candidate_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567aad74196e41e58e3f38882cdd0cc3" is_pre_election: true
I20260618 23:19:40.923692 6297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:40.920067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:45473 (local address 127.3.217.130:50763)
0618 23:19:40.920259 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:40.920269 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:40.920309 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:40.920645 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:40.920646 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:40.920647 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:40.920836 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:40.920837 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.921607 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.921608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:40.922761 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:40.922763 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.923466 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.923467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:40.923535 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:40.923539 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:19:40.923591 (+ 52us) client_negotiation.cc:240] Negotiation successful
0618 23:19:40.923623 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":87,"threads_started":1}
I20260618 23:19:40.923712 5837 raft_consensus.cc:2454] T 6996ef88da3a4bf19ccf49aa19815978 P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98b43a3d9e94ba2818fa7d3d2b0f59f in term 0.
I20260618 23:19:40.923733 6298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:40.920409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:50763 (local address 127.3.217.131:45473)
0618 23:19:40.920537 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:40.920539 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:40.920546 (+ 7us) server_negotiation.cc:407] Connection header received
0618 23:19:40.920569 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:40.920570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:40.920581 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:40.920646 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:40.920913 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.921505 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.922855 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.923386 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.923462 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:40.923469 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:40.923614 (+ 145us) server_negotiation.cc:299] Negotiation successful
0618 23:19:40.923652 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":66,"threads_started":1}
I20260618 23:19:40.923913 6117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6996ef88da3a4bf19ccf49aa19815978" candidate_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7ac1a31326d41578dd4829e82e2f97b" is_pre_election: true
I20260618 23:19:40.923983 6117 raft_consensus.cc:2454] T 6996ef88da3a4bf19ccf49aa19815978 P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98b43a3d9e94ba2818fa7d3d2b0f59f in term 0.
I20260618 23:19:40.923992 5909 leader_election.cc:302] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567aad74196e41e58e3f38882cdd0cc3, b98b43a3d9e94ba2818fa7d3d2b0f59f; no voters:
I20260618 23:19:40.924106 6283 raft_consensus.cc:2781] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:19:40.924149 6283 raft_consensus.cc:482] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:19:40.924177 6283 raft_consensus.cc:3037] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:40.925271 6283 raft_consensus.cc:504] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:40.925426 6283 leader_election.cc:288] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f [CANDIDATE]: Term 1 election: Requested vote from peers 567aad74196e41e58e3f38882cdd0cc3 (127.3.217.129:39407), c7ac1a31326d41578dd4829e82e2f97b (127.3.217.131:45473)
I20260618 23:19:40.925581 5837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6996ef88da3a4bf19ccf49aa19815978" candidate_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567aad74196e41e58e3f38882cdd0cc3"
I20260618 23:19:40.925645 6117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6996ef88da3a4bf19ccf49aa19815978" candidate_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7ac1a31326d41578dd4829e82e2f97b"
I20260618 23:19:40.925747 6117 raft_consensus.cc:3037] T 6996ef88da3a4bf19ccf49aa19815978 P c7ac1a31326d41578dd4829e82e2f97b [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:40.925658 5837 raft_consensus.cc:3037] T 6996ef88da3a4bf19ccf49aa19815978 P 567aad74196e41e58e3f38882cdd0cc3 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:40.926296 6117 raft_consensus.cc:2454] T 6996ef88da3a4bf19ccf49aa19815978 P c7ac1a31326d41578dd4829e82e2f97b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98b43a3d9e94ba2818fa7d3d2b0f59f in term 1.
I20260618 23:19:40.926457 5910 leader_election.cc:302] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98b43a3d9e94ba2818fa7d3d2b0f59f, c7ac1a31326d41578dd4829e82e2f97b; no voters:
I20260618 23:19:40.926518 5837 raft_consensus.cc:2454] T 6996ef88da3a4bf19ccf49aa19815978 P 567aad74196e41e58e3f38882cdd0cc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98b43a3d9e94ba2818fa7d3d2b0f59f in term 1.
I20260618 23:19:40.926537 6283 raft_consensus.cc:2781] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:40.926681 6283 raft_consensus.cc:686] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 1 LEADER]: Becoming Leader. State: Replica: b98b43a3d9e94ba2818fa7d3d2b0f59f, State: Running, Role: LEADER
I20260618 23:19:40.926774 6283 consensus_queue.cc:237] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } }
I20260618 23:19:40.927454 5680 catalog_manager.cc:5495] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f reported cstate change: term changed from 0 to 1, leader changed from <none> to b98b43a3d9e94ba2818fa7d3d2b0f59f (127.3.217.130). New cstate: current_term: 1 leader_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b98b43a3d9e94ba2818fa7d3d2b0f59f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 33013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260618 23:19:40.942452 6301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:40.939680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53504 (local address 127.3.217.130:33013)
0618 23:19:40.939846 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:40.939848 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:40.939855 (+ 7us) server_negotiation.cc:407] Connection header received
0618 23:19:40.939891 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:40.939892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:40.939908 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:40.940002 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:19:40.940110 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.940742 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.941587 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.941833 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.941902 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:40.942027 (+ 125us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:19:40.942143 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:19:40.942218 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:40.942287 (+ 69us) server_negotiation.cc:299] Negotiation successful
0618 23:19:40.942305 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":123,"threads_started":1}
I20260618 23:19:40.948359 6286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:40.944902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:51571 (local address 127.3.217.129:39407)
0618 23:19:40.944943 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:40.944945 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:40.944955 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:19:40.945015 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:40.945016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:40.945036 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:40.945276 (+ 240us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:19:40.945512 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.946274 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.947339 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.947646 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.947740 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:40.948028 (+ 288us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:19:40.948059 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:19:40.948111 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:40.948264 (+ 153us) server_negotiation.cc:299] Negotiation successful
0618 23:19:40.948284 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260618 23:19:40.948421 6304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:40.944704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:39407 (local address 127.3.217.130:51571)
0618 23:19:40.944890 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:40.944900 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:40.944955 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:40.945266 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:40.945267 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:40.945271 (+ 4us) client_negotiation.cc:189] Negotiated authn=TOKEN
0618 23:19:40.945367 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:40.945369 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.946393 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.946394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:40.947249 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:40.947251 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.947772 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.947773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:40.947887 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:40.947931 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0618 23:19:40.948181 (+ 250us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0618 23:19:40.948184 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:19:40.948243 (+ 59us) client_negotiation.cc:240] Negotiation successful
0618 23:19:40.948298 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":80,"threads_started":1}
I20260618 23:19:40.953050 5837 raft_consensus.cc:1261] T 6996ef88da3a4bf19ccf49aa19815978 P 567aad74196e41e58e3f38882cdd0cc3 [term 1 FOLLOWER]: Refusing update from remote peer b98b43a3d9e94ba2818fa7d3d2b0f59f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:19:40.953047 6117 raft_consensus.cc:1261] T 6996ef88da3a4bf19ccf49aa19815978 P c7ac1a31326d41578dd4829e82e2f97b [term 1 FOLLOWER]: Refusing update from remote peer b98b43a3d9e94ba2818fa7d3d2b0f59f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:19:40.953299 6283 consensus_queue.cc:1035] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7ac1a31326d41578dd4829e82e2f97b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:19:40.953500 6299 consensus_queue.cc:1035] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f [LEADER]: Connected to new peer: Peer: permanent_uuid: "567aad74196e41e58e3f38882cdd0cc3" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:19:40.960835 6301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:40.958213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:33049 (local address 127.3.217.130:33013)
0618 23:19:40.958266 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:40.958268 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:40.958275 (+ 7us) server_negotiation.cc:407] Connection header received
0618 23:19:40.958296 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:40.958296 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:40.958306 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:40.958359 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:19:40.958458 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.958971 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.960262 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.960459 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.960523 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:40.960668 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:19:40.960691 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:19:40.960724 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:40.960771 (+ 47us) server_negotiation.cc:299] Negotiation successful
0618 23:19:40.960785 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260618 23:19:40.960855 6289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:40.958056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:33013 (local address 127.3.217.129:33049)
0618 23:19:40.958089 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:40.958101 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:40.958141 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:40.958369 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:40.958370 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:40.958372 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0618 23:19:40.958415 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:40.958416 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.959106 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.959107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:40.960183 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:40.960186 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:40.960560 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:40.960560 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:40.960604 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:40.960610 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0618 23:19:40.960735 (+ 125us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0618 23:19:40.960737 (+ 2us) client_negotiation.cc:769] Sending connection context
0618 23:19:40.960771 (+ 34us) client_negotiation.cc:240] Negotiation successful
0618 23:19:40.960805 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13}
W20260618 23:19:40.961158 6249 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260618 23:19:42.484233 5680 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:19:42.484352 5680 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:19:42.485461 5680 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d5bf8983721e4d95a0da588ef24ce5f2: Sending DeleteTablet for 3 replicas of tablet 6996ef88da3a4bf19ccf49aa19815978
I20260618 23:19:42.485821 6097 tablet_service.cc:1514] Processing DeleteTablet for tablet 6996ef88da3a4bf19ccf49aa19815978 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:42 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:44646
I20260618 23:19:42.485818 5957 tablet_service.cc:1514] Processing DeleteTablet for tablet 6996ef88da3a4bf19ccf49aa19815978 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:42 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:53498
I20260618 23:19:42.485872 5816 tablet_service.cc:1514] Processing DeleteTablet for tablet 6996ef88da3a4bf19ccf49aa19815978 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:42 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:47518
I20260618 23:19:42.486063 6334 tablet_replica.cc:330] T 6996ef88da3a4bf19ccf49aa19815978 P c7ac1a31326d41578dd4829e82e2f97b: stopping tablet replica
I20260618 23:19:42.486130 6334 raft_consensus.cc:2229] T 6996ef88da3a4bf19ccf49aa19815978 P c7ac1a31326d41578dd4829e82e2f97b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:19:42.486181 6334 raft_consensus.cc:2258] T 6996ef88da3a4bf19ccf49aa19815978 P c7ac1a31326d41578dd4829e82e2f97b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:42.486238 6335 tablet_replica.cc:330] T 6996ef88da3a4bf19ccf49aa19815978 P 567aad74196e41e58e3f38882cdd0cc3: stopping tablet replica
I20260618 23:19:42.486308 6333 tablet_replica.cc:330] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f: stopping tablet replica
I20260618 23:19:42.486312 6335 raft_consensus.cc:2229] T 6996ef88da3a4bf19ccf49aa19815978 P 567aad74196e41e58e3f38882cdd0cc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:19:42.486369 6333 raft_consensus.cc:2229] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:19:42.486378 6335 raft_consensus.cc:2258] T 6996ef88da3a4bf19ccf49aa19815978 P 567aad74196e41e58e3f38882cdd0cc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:42.486430 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 5752
I20260618 23:19:42.486466 6333 raft_consensus.cc:2258] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:42.487159 6334 ts_tablet_manager.cc:1905] T 6996ef88da3a4bf19ccf49aa19815978 P c7ac1a31326d41578dd4829e82e2f97b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:19:42.487317 6333 ts_tablet_manager.cc:1905] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:19:42.489328 6334 ts_tablet_manager.cc:1918] T 6996ef88da3a4bf19ccf49aa19815978 P c7ac1a31326d41578dd4829e82e2f97b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260618 23:19:42.489439 6334 log.cc:1196] T 6996ef88da3a4bf19ccf49aa19815978 P c7ac1a31326d41578dd4829e82e2f97b: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/6996ef88da3a4bf19ccf49aa19815978
I20260618 23:19:42.489672 6334 ts_tablet_manager.cc:1939] T 6996ef88da3a4bf19ccf49aa19815978 P c7ac1a31326d41578dd4829e82e2f97b: Deleting consensus metadata
I20260618 23:19:42.490039 5666 catalog_manager.cc:4841] TS c7ac1a31326d41578dd4829e82e2f97b (127.3.217.131:45473): tablet 6996ef88da3a4bf19ccf49aa19815978 (table test-table [id=cba2d565129b482f858be051b16c2f9a]) successfully deleted
I20260618 23:19:42.490348 6333 ts_tablet_manager.cc:1918] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260618 23:19:42.490414 6333 log.cc:1196] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/6996ef88da3a4bf19ccf49aa19815978
I20260618 23:19:42.490664 6333 ts_tablet_manager.cc:1939] T 6996ef88da3a4bf19ccf49aa19815978 P b98b43a3d9e94ba2818fa7d3d2b0f59f: Deleting consensus metadata
I20260618 23:19:42.490996 5667 catalog_manager.cc:4841] TS b98b43a3d9e94ba2818fa7d3d2b0f59f (127.3.217.130:33013): tablet 6996ef88da3a4bf19ccf49aa19815978 (table test-table [id=cba2d565129b482f858be051b16c2f9a]) successfully deleted
W20260618 23:19:42.495520 5665 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.217.129:39407 (error 108)
I20260618 23:19:42.495740 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 5892
I20260618 23:19:42.496822 6337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:42.496601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:39407 (local address 127.0.0.1:47542)
0618 23:19:42.496738 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:42.496783 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.129:39407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":74,"threads_started":1}
W20260618 23:19:42.496958 5665 catalog_manager.cc:4584] TS 567aad74196e41e58e3f38882cdd0cc3 (127.3.217.129:39407): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6996ef88da3a4bf19ccf49aa19815978: Network error: Client connection negotiation failed: client connection to 127.3.217.129:39407: connect: Connection refused (error 111)
I20260618 23:19:42.503289 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 6032
I20260618 23:19:42.508683 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 5648
2026-06-18T23:19:42Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6277 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:19:42 dist-test-slave-r9ct krb5kdc[6340](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:19:42 dist-test-slave-r9ct krb5kdc[6340](info): set up 2 sockets
Jun 18 23:19:42 dist-test-slave-r9ct krb5kdc[6340](info): commencing operation
krb5kdc: starting...
W20260618 23:19:43.567068 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:19:43 dist-test-slave-r9ct krb5kdc[6340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824783, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:19:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:19:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:19:43.694612 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:41777
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:34003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:41777
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:43.775095 6353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:43.775317 6353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:43.775352 6353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:43.776780 6353 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:19:43.776873 6353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:43.776903 6353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:43.776935 6353 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:19:43.776957 6353 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:19:43.778424 6353 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:34003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:41777
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:41777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:43.778690 6353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:43.778975 6353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:43.784241 6361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:43.784291 6359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:43.784312 6358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:43.784343 6353 server_base.cc:1034] running on GCE node
I20260618 23:19:43.784713 6353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:43.784956 6353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:43.786139 6353 hybrid_clock.cc:648] HybridClock initialized: now 1781824783786126 us; error 42 us; skew 500 ppm
Jun 18 23:19:43 dist-test-slave-r9ct krb5kdc[6340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824783, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:43.788782 6353 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:19:43.789268 6353 webserver.cc:460] Webserver started at http://127.3.217.190:34593/ using document root <none> and password file <none>
I20260618 23:19:43.789529 6353 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:43.789595 6353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:43.789740 6353 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:43.790947 6353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "349fa7d94e394ba3b983da6c9fbbad50"
format_stamp: "Formatted at 2026-06-18 23:19:43 on dist-test-slave-r9ct"
server_key: "e5c56fbafa368229174640ccee3d4494"
server_key_iv: "10a88b3d6498f2cddf6922aaf1b6fd5a"
server_key_version: "encryptionkey@0"
I20260618 23:19:43.791306 6353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "349fa7d94e394ba3b983da6c9fbbad50"
format_stamp: "Formatted at 2026-06-18 23:19:43 on dist-test-slave-r9ct"
server_key: "e5c56fbafa368229174640ccee3d4494"
server_key_iv: "10a88b3d6498f2cddf6922aaf1b6fd5a"
server_key_version: "encryptionkey@0"
I20260618 23:19:43.792922 6353 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:43.794204 6368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:43.794553 6353 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:43.794697 6353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "349fa7d94e394ba3b983da6c9fbbad50"
format_stamp: "Formatted at 2026-06-18 23:19:43 on dist-test-slave-r9ct"
server_key: "e5c56fbafa368229174640ccee3d4494"
server_key_iv: "10a88b3d6498f2cddf6922aaf1b6fd5a"
server_key_version: "encryptionkey@0"
I20260618 23:19:43.794852 6353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:43.815675 6353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:43.817900 6353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:43.818069 6353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:43.822433 6353 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:41777
I20260618 23:19:43.822546 6420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:41777 every 8 connection(s)
I20260618 23:19:43.822901 6353 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:19:43.823779 6421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:43.826017 6421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50: Bootstrap starting.
I20260618 23:19:43.826579 6421 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:43.826910 6421 log.cc:824] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:43.827579 6421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50: No bootstrap required, opened a new log
I20260618 23:19:43.829198 6421 raft_consensus.cc:348] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "349fa7d94e394ba3b983da6c9fbbad50" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41777 } }
I20260618 23:19:43.829391 6421 raft_consensus.cc:374] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:43.829437 6421 raft_consensus.cc:729] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 349fa7d94e394ba3b983da6c9fbbad50, State: Initialized, Role: FOLLOWER
I20260618 23:19:43.829463 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 6353
I20260618 23:19:43.829572 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:19:43.829598 6421 consensus_queue.cc:260] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "349fa7d94e394ba3b983da6c9fbbad50" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41777 } }
I20260618 23:19:43.829679 6421 raft_consensus.cc:388] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:19:43.829710 6421 raft_consensus.cc:482] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:19:43.829751 6421 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:43.829761 3942 external_mini_cluster.cc:1428] Setting key cfef4590d01ca8033d6c6ae6c4176ebe
I20260618 23:19:43.830375 6421 raft_consensus.cc:504] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "349fa7d94e394ba3b983da6c9fbbad50" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41777 } }
I20260618 23:19:43.830487 6421 leader_election.cc:302] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 349fa7d94e394ba3b983da6c9fbbad50; no voters:
I20260618 23:19:43.830639 6421 leader_election.cc:288] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:19:43.830873 6426 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:43.830915 6421 sys_catalog.cc:564] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:19:43.831022 6426 raft_consensus.cc:686] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50 [term 1 LEADER]: Becoming Leader. State: Replica: 349fa7d94e394ba3b983da6c9fbbad50, State: Running, Role: LEADER
I20260618 23:19:43.831112 6426 consensus_queue.cc:237] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "349fa7d94e394ba3b983da6c9fbbad50" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41777 } }
I20260618 23:19:43.831456 6427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "349fa7d94e394ba3b983da6c9fbbad50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "349fa7d94e394ba3b983da6c9fbbad50" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41777 } } }
I20260618 23:19:43.831435 6426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 349fa7d94e394ba3b983da6c9fbbad50. Latest consensus state: current_term: 1 leader_uuid: "349fa7d94e394ba3b983da6c9fbbad50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "349fa7d94e394ba3b983da6c9fbbad50" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41777 } } }
I20260618 23:19:43.831641 6426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50 [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:43.831831 6427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50 [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:43.832307 6435 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:19:43.832898 6435 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:19:43.834343 6435 catalog_manager.cc:1347] Generated new cluster ID: 24b828c1d97b41659b502030c42294dc
I20260618 23:19:43.834401 6435 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 18 23:19:43 dist-test-slave-r9ct krb5kdc[6340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824783, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:43.842001 6425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:43.830346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52608 (local address 127.3.217.190:41777)
0618 23:19:43.830561 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:43.830570 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:43.830606 (+ 36us) server_negotiation.cc:407] Connection header received
0618 23:19:43.830745 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:43.830753 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:43.830823 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:43.831820 (+ 997us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:43.831934 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:43.833265 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:43.834228 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:43.834856 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:43.834958 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:43.837920 (+ 2962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:43.837927 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:43.837927 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:43.837946 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:43.840182 (+ 2236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:43.840564 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:43.840568 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:43.840568 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:43.840659 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:43.840814 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:43.840815 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:43.840815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:43.841086 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:43.841212 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:43.841645 (+ 433us) server_negotiation.cc:299] Negotiation successful
0618 23:19:43.841768 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":92,"threads_started":1}
I20260618 23:19:43.849222 6435 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:19:43.849772 6435 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:19:43.853283 6435 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 349fa7d94e394ba3b983da6c9fbbad50: Generated new TSK 0
I20260618 23:19:43.853572 6435 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.217.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
I20260618 23:19:43.887629 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:41777
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:34003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:43.974265 6447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:43.974457 6447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:43.974479 6447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:43.975615 6447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:43.975656 6447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:43.975682 6447 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:19:43.977176 6447 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:34003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:41777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6447
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:43.977422 6447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:43.977653 6447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:43.982553 6453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:43.982563 6455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:43.982597 6452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:43.983053 6447 server_base.cc:1034] running on GCE node
I20260618 23:19:43.983253 6447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:43.983486 6447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:43.984656 6447 hybrid_clock.cc:648] HybridClock initialized: now 1781824783984644 us; error 37 us; skew 500 ppm
Jun 18 23:19:43 dist-test-slave-r9ct krb5kdc[6340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824783, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:43.987468 6447 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:19:43.987962 6447 webserver.cc:460] Webserver started at http://127.3.217.129:43919/ using document root <none> and password file <none>
I20260618 23:19:43.988179 6447 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:43.988241 6447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:43.988366 6447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:43.989432 6447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "e3df13dd1e3643f5b53e5c64d2319a93"
format_stamp: "Formatted at 2026-06-18 23:19:43 on dist-test-slave-r9ct"
server_key: "2525dca8c51b51ddd8d6818a8746de9e"
server_key_iv: "d189fb4c734f489b091892e7b121f57b"
server_key_version: "encryptionkey@0"
I20260618 23:19:43.989795 6447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "e3df13dd1e3643f5b53e5c64d2319a93"
format_stamp: "Formatted at 2026-06-18 23:19:43 on dist-test-slave-r9ct"
server_key: "2525dca8c51b51ddd8d6818a8746de9e"
server_key_iv: "d189fb4c734f489b091892e7b121f57b"
server_key_version: "encryptionkey@0"
I20260618 23:19:43.991099 6447 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260618 23:19:43.991874 6462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:43.992187 6447 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:43.992278 6447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "e3df13dd1e3643f5b53e5c64d2319a93"
format_stamp: "Formatted at 2026-06-18 23:19:43 on dist-test-slave-r9ct"
server_key: "2525dca8c51b51ddd8d6818a8746de9e"
server_key_iv: "d189fb4c734f489b091892e7b121f57b"
server_key_version: "encryptionkey@0"
I20260618 23:19:43.992352 6447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:44.009545 6447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:44.011644 6447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:44.011821 6447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:44.012068 6447 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:44.012360 6447 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:44.012413 6447 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:44.012447 6447 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:44.012475 6447 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:44.019750 6447 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:32903
I20260618 23:19:44.019790 6575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:32903 every 8 connection(s)
I20260618 23:19:44.020104 6447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:19:44.023000 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 6447
I20260618 23:19:44.023084 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:19:44.023252 3942 external_mini_cluster.cc:1428] Setting key 0f0ff682ef317bf7f2fcaba0ad6cf4b4
Jun 18 23:19:44 dist-test-slave-r9ct krb5kdc[6340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824783, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:44.030449 6425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:44.020864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:49867 (local address 127.3.217.190:41777)
0618 23:19:44.020929 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:44.020932 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:44.021255 (+ 323us) server_negotiation.cc:407] Connection header received
0618 23:19:44.021675 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:44.021676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:44.021689 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:44.021744 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:44.022625 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:44.023247 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:44.024490 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:44.024681 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:44.024756 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:44.027245 (+ 2489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:44.027247 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:44.027247 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:44.027254 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:44.028820 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:44.029329 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:44.029330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:44.029331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:44.029386 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:44.029700 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:44.029701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:44.029701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:44.029822 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:44.029916 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:44.030290 (+ 374us) server_negotiation.cc:299] Negotiation successful
0618 23:19:44.030379 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260618 23:19:44.030666 6578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:44.020765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:41777 (local address 127.3.217.129:49867)
0618 23:19:44.021084 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:44.021120 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:44.021584 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:44.021793 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:44.021796 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:44.022351 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:44.022533 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:44.022536 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:44.023349 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:44.023351 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:44.024395 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:44.024398 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:44.024773 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:44.024774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:44.024923 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:44.025620 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:44.025628 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:44.027144 (+ 1516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:44.028903 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:44.028910 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:44.028912 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:44.029238 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:44.029461 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:44.029462 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:44.029462 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:44.029608 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:44.029924 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:44.029931 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:44.030098 (+ 167us) client_negotiation.cc:769] Sending connection context
0618 23:19:44.030216 (+ 118us) client_negotiation.cc:240] Negotiation successful
0618 23:19:44.030392 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":133,"threads_started":1}
I20260618 23:19:44.031323 6576 heartbeater.cc:347] Connected to a master server at 127.3.217.190:41777
I20260618 23:19:44.031491 6576 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:44.031684 6576 heartbeater.cc:511] Master 127.3.217.190:41777 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.3.217.130@KRBTEST.COM; defaulting to no policy
I20260618 23:19:44.032276 6385 ts_manager.cc:194] Registered new tserver with Master: e3df13dd1e3643f5b53e5c64d2319a93 (127.3.217.129:32903)
I20260618 23:19:44.033020 6385 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:49867
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
I20260618 23:19:44.051393 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:41777
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:34003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:44.134668 6581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:44.134997 6581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:44.135032 6581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:44.137303 6581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:44.137408 6581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:44.137458 6581 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:19:44.140782 6581 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:34003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:41777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6581
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:44.141064 6581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:44.141301 6581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:44.146862 6589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:44.146946 6587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:44.147158 6586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:44.147545 6581 server_base.cc:1034] running on GCE node
I20260618 23:19:44.147768 6581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:44.148025 6581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:44.149180 6581 hybrid_clock.cc:648] HybridClock initialized: now 1781824784149174 us; error 38 us; skew 500 ppm
Jun 18 23:19:44 dist-test-slave-r9ct krb5kdc[6340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824784, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:44.152268 6581 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:19:44.152755 6581 webserver.cc:460] Webserver started at http://127.3.217.130:46539/ using document root <none> and password file <none>
I20260618 23:19:44.153123 6581 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:44.153236 6581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:44.153426 6581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:44.154875 6581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "9790b21d184d4e72a41c1af587e480e9"
format_stamp: "Formatted at 2026-06-18 23:19:44 on dist-test-slave-r9ct"
server_key: "0bb65e85c36d3e60787d5779b4fdb81d"
server_key_iv: "2a6587ace625c036a786a1694461367f"
server_key_version: "encryptionkey@0"
I20260618 23:19:44.155280 6581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "9790b21d184d4e72a41c1af587e480e9"
format_stamp: "Formatted at 2026-06-18 23:19:44 on dist-test-slave-r9ct"
server_key: "0bb65e85c36d3e60787d5779b4fdb81d"
server_key_iv: "2a6587ace625c036a786a1694461367f"
server_key_version: "encryptionkey@0"
I20260618 23:19:44.156641 6581 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260618 23:19:44.157455 6596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:44.157730 6581 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:19:44.157809 6581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "9790b21d184d4e72a41c1af587e480e9"
format_stamp: "Formatted at 2026-06-18 23:19:44 on dist-test-slave-r9ct"
server_key: "0bb65e85c36d3e60787d5779b4fdb81d"
server_key_iv: "2a6587ace625c036a786a1694461367f"
server_key_version: "encryptionkey@0"
I20260618 23:19:44.157925 6581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:44.181982 6581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:44.184367 6581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:44.184518 6581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:44.184768 6581 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:44.185084 6581 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:44.185117 6581 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:44.185161 6581 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:44.185186 6581 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:44.191301 6581 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:46281
I20260618 23:19:44.191427 6709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:46281 every 8 connection(s)
I20260618 23:19:44.191679 6581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:19:44.196929 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 6581
I20260618 23:19:44.197022 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:19:44.197265 3942 external_mini_cluster.cc:1428] Setting key 219c74afe947144a52577d539ed79237
Jun 18 23:19:44 dist-test-slave-r9ct krb5kdc[6340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824784, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:44.201516 6425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:44.192421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:57151 (local address 127.3.217.190:41777)
0618 23:19:44.192488 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:44.192490 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:44.192657 (+ 167us) server_negotiation.cc:407] Connection header received
0618 23:19:44.193180 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:44.193182 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:44.193191 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:44.193249 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:44.194180 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:44.194686 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:44.195785 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:44.196064 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:44.196127 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:44.198599 (+ 2472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:44.198600 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:44.198600 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:44.198608 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:44.200186 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:44.200597 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:44.200598 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:44.200599 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:44.200655 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:44.200906 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:44.200907 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:44.200907 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:44.201018 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:44.201088 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:44.201346 (+ 258us) server_negotiation.cc:299] Negotiation successful
0618 23:19:44.201427 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260618 23:19:44.201751 6712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:44.192374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:41777 (local address 127.3.217.130:57151)
0618 23:19:44.192545 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:44.192580 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:44.193040 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:44.193347 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:44.193354 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:44.193906 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:44.194094 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:44.194098 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:44.194816 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:44.194817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:44.195692 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:44.195694 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:44.196152 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:44.196153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:44.196258 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:44.196819 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:44.196828 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:44.198485 (+ 1657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:44.200284 (+ 1799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:44.200291 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:44.200294 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:44.200510 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:44.200718 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:44.200719 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:44.200720 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:44.200843 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:44.201081 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:44.201086 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:44.201220 (+ 134us) client_negotiation.cc:769] Sending connection context
0618 23:19:44.201328 (+ 108us) client_negotiation.cc:240] Negotiation successful
0618 23:19:44.201479 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":97,"threads_started":1}
I20260618 23:19:44.202157 6710 heartbeater.cc:347] Connected to a master server at 127.3.217.190:41777
I20260618 23:19:44.202242 6710 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:44.202435 6710 heartbeater.cc:511] Master 127.3.217.190:41777 requested a full tablet report, sending...
I20260618 23:19:44.203028 6385 ts_manager.cc:194] Registered new tserver with Master: 9790b21d184d4e72a41c1af587e480e9 (127.3.217.130:46281)
I20260618 23:19:44.203377 6385 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:57151
WARNING: no policy specified for kudu/127.3.217.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
I20260618 23:19:44.226576 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:41777
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:34003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:44.308204 6715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:44.308406 6715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:44.308429 6715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:44.309482 6715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:44.309520 6715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:44.309545 6715 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:19:44.311049 6715 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:34003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:41777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6715
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:44.311235 6715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:44.311416 6715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:44.317180 6720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:44.317181 6721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:44.317307 6723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:44.317548 6715 server_base.cc:1034] running on GCE node
I20260618 23:19:44.317761 6715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:44.318014 6715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:44.319195 6715 hybrid_clock.cc:648] HybridClock initialized: now 1781824784319190 us; error 37 us; skew 500 ppm
Jun 18 23:19:44 dist-test-slave-r9ct krb5kdc[6340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824784, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:44.321923 6715 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:19:44.322376 6715 webserver.cc:460] Webserver started at http://127.3.217.131:36167/ using document root <none> and password file <none>
I20260618 23:19:44.322587 6715 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:44.322650 6715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:44.322803 6715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:44.323808 6715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "3055dd1dd92d462ebd5bbe9b7f91b6eb"
format_stamp: "Formatted at 2026-06-18 23:19:44 on dist-test-slave-r9ct"
server_key: "bd4454deb5aa1efed66d977e550de6be"
server_key_iv: "a051100489e19eb92beb01d86ae4f144"
server_key_version: "encryptionkey@0"
I20260618 23:19:44.324156 6715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "3055dd1dd92d462ebd5bbe9b7f91b6eb"
format_stamp: "Formatted at 2026-06-18 23:19:44 on dist-test-slave-r9ct"
server_key: "bd4454deb5aa1efed66d977e550de6be"
server_key_iv: "a051100489e19eb92beb01d86ae4f144"
server_key_version: "encryptionkey@0"
I20260618 23:19:44.325466 6715 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260618 23:19:44.326371 6730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:44.326586 6715 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:44.326757 6715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "3055dd1dd92d462ebd5bbe9b7f91b6eb"
format_stamp: "Formatted at 2026-06-18 23:19:44 on dist-test-slave-r9ct"
server_key: "bd4454deb5aa1efed66d977e550de6be"
server_key_iv: "a051100489e19eb92beb01d86ae4f144"
server_key_version: "encryptionkey@0"
I20260618 23:19:44.326853 6715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:44.342087 6715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:44.344657 6715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:44.344853 6715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:44.345121 6715 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:44.345459 6715 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:44.345515 6715 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:44.345553 6715 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:44.345594 6715 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:44.352082 6715 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:42517
I20260618 23:19:44.352133 6843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:42517 every 8 connection(s)
I20260618 23:19:44.352451 6715 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
Jun 18 23:19:44 dist-test-slave-r9ct krb5kdc[6340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824784, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:44.361886 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 6715
I20260618 23:19:44.361991 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:19:44.362164 3942 external_mini_cluster.cc:1428] Setting key 976e7ef49f8034d4fc47bd547f27cc94
I20260618 23:19:44.362540 6425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:44.353223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:36665 (local address 127.3.217.190:41777)
0618 23:19:44.353287 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:44.353289 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:44.353456 (+ 167us) server_negotiation.cc:407] Connection header received
0618 23:19:44.354005 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:44.354006 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:44.354018 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:44.354063 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:44.355027 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:44.355515 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:44.356472 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:44.356675 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:44.356754 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:44.359216 (+ 2462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:44.359219 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:44.359219 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:44.359229 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:44.360944 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:44.361333 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:44.361334 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:44.361334 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:44.361396 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:44.361763 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:44.361764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:44.361765 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:44.361924 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:44.362014 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:44.362361 (+ 347us) server_negotiation.cc:299] Negotiation successful
0618 23:19:44.362444 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260618 23:19:44.362854 6846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:44.353121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:41777 (local address 127.3.217.131:36665)
0618 23:19:44.353310 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:44.353351 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:44.353893 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:44.354138 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:44.354141 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:44.354755 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:44.354941 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:44.354946 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:44.355601 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:44.355602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:44.356365 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:44.356368 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:44.356764 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:44.356765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:44.356880 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:44.357383 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:44.357391 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:44.359083 (+ 1692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:44.361026 (+ 1943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:44.361032 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:44.361033 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:44.361257 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:44.361472 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:44.361472 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:44.361472 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:44.361588 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:44.362040 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:44.362046 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:44.362181 (+ 135us) client_negotiation.cc:769] Sending connection context
0618 23:19:44.362336 (+ 155us) client_negotiation.cc:240] Negotiation successful
0618 23:19:44.362524 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":95,"threads_started":1}
I20260618 23:19:44.363297 6844 heartbeater.cc:347] Connected to a master server at 127.3.217.190:41777
I20260618 23:19:44.363401 6844 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:44.363565 6844 heartbeater.cc:511] Master 127.3.217.190:41777 requested a full tablet report, sending...
I20260618 23:19:44.364012 6385 ts_manager.cc:194] Registered new tserver with Master: 3055dd1dd92d462ebd5bbe9b7f91b6eb (127.3.217.131:42517)
I20260618 23:19:44.364425 6385 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:36665
I20260618 23:19:44.374382 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260618 23:19:44.386765 6425 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:19:44.385457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44950 (local address 127.3.217.190:41777)
0618 23:19:44.385579 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:44.385582 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:44.385719 (+ 137us) server_negotiation.cc:407] Connection header received
0618 23:19:44.385853 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:44.385855 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:44.385873 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:44.385936 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:44.386635 (+ 699us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44950: BlockingRecv error: recv got EOF from 127.0.0.1:44950 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260618 23:19:44.387933 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 6447
I20260618 23:19:44.392659 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 6581
I20260618 23:19:44.397003 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 6715
I20260618 23:19:44.401202 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 6353
2026-06-18T23:19:44Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1892 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:19:44 dist-test-slave-r9ct krb5kdc[6856](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:19:44 dist-test-slave-r9ct krb5kdc[6856](info): set up 2 sockets
Jun 18 23:19:44 dist-test-slave-r9ct krb5kdc[6856](info): commencing operation
krb5kdc: starting...
W20260618 23:19:45.487571 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.065s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:19:45 dist-test-slave-r9ct krb5kdc[6856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824785, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:19:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:19:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:19:45.626163 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:33025
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:36699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:33025
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:45.714448 6869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:45.714672 6869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:45.714695 6869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:45.715914 6869 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:19:45.715968 6869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:45.715983 6869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:45.715996 6869 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:19:45.716009 6869 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:19:45.717483 6869 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:36699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:33025
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:33025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6869
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:45.717723 6869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:45.718078 6869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:45.723133 6877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:45.723336 6875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:45.723353 6874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:45.723498 6869 server_base.cc:1034] running on GCE node
I20260618 23:19:45.723759 6869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:45.724066 6869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:45.725251 6869 hybrid_clock.cc:648] HybridClock initialized: now 1781824785725218 us; error 52 us; skew 500 ppm
Jun 18 23:19:45 dist-test-slave-r9ct krb5kdc[6856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824785, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:45.732869 6869 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:19:45.733621 6869 webserver.cc:460] Webserver started at http://127.3.217.190:40613/ using document root <none> and password file <none>
I20260618 23:19:45.733970 6869 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:45.734041 6869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:45.734247 6869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:45.735688 6869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "9ddb4d2aba594a92af7cfff8c08f6477"
format_stamp: "Formatted at 2026-06-18 23:19:45 on dist-test-slave-r9ct"
server_key: "6dda3abadacb7d91308b38d44a2a998b"
server_key_iv: "027e4f760b86cede704c00b7db4c3b7b"
server_key_version: "encryptionkey@0"
I20260618 23:19:45.736159 6869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "9ddb4d2aba594a92af7cfff8c08f6477"
format_stamp: "Formatted at 2026-06-18 23:19:45 on dist-test-slave-r9ct"
server_key: "6dda3abadacb7d91308b38d44a2a998b"
server_key_iv: "027e4f760b86cede704c00b7db4c3b7b"
server_key_version: "encryptionkey@0"
I20260618 23:19:45.737982 6869 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260618 23:19:45.739132 6884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:45.739338 6869 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:45.739476 6869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "9ddb4d2aba594a92af7cfff8c08f6477"
format_stamp: "Formatted at 2026-06-18 23:19:45 on dist-test-slave-r9ct"
server_key: "6dda3abadacb7d91308b38d44a2a998b"
server_key_iv: "027e4f760b86cede704c00b7db4c3b7b"
server_key_version: "encryptionkey@0"
I20260618 23:19:45.739560 6869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:45.755420 6869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:45.758875 6869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:45.759049 6869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:45.765079 6869 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:33025
I20260618 23:19:45.765126 6936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:33025 every 8 connection(s)
I20260618 23:19:45.765573 6869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:19:45.766564 6937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:45.769038 6937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477: Bootstrap starting.
I20260618 23:19:45.769663 6937 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:45.769901 6937 log.cc:824] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:45.770598 6937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477: No bootstrap required, opened a new log
I20260618 23:19:45.771520 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 6869
I20260618 23:19:45.771615 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:19:45.771780 3942 external_mini_cluster.cc:1428] Setting key 47f01090f0e157bb1aa112fe6000b3a1
I20260618 23:19:45.773200 6937 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ddb4d2aba594a92af7cfff8c08f6477" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33025 } }
I20260618 23:19:45.773355 6937 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:45.773398 6937 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ddb4d2aba594a92af7cfff8c08f6477, State: Initialized, Role: FOLLOWER
I20260618 23:19:45.773574 6937 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ddb4d2aba594a92af7cfff8c08f6477" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33025 } }
I20260618 23:19:45.773671 6937 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:19:45.773706 6937 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:19:45.773764 6937 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:45.774487 6937 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ddb4d2aba594a92af7cfff8c08f6477" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33025 } }
I20260618 23:19:45.774571 6937 leader_election.cc:302] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ddb4d2aba594a92af7cfff8c08f6477; no voters:
I20260618 23:19:45.774784 6937 leader_election.cc:288] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:19:45.774991 6943 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:45.775040 6937 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:19:45.775236 6943 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477 [term 1 LEADER]: Becoming Leader. State: Replica: 9ddb4d2aba594a92af7cfff8c08f6477, State: Running, Role: LEADER
I20260618 23:19:45.775374 6943 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ddb4d2aba594a92af7cfff8c08f6477" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33025 } }
I20260618 23:19:45.775831 6943 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ddb4d2aba594a92af7cfff8c08f6477. Latest consensus state: current_term: 1 leader_uuid: "9ddb4d2aba594a92af7cfff8c08f6477" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ddb4d2aba594a92af7cfff8c08f6477" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33025 } } }
I20260618 23:19:45.775844 6944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ddb4d2aba594a92af7cfff8c08f6477" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ddb4d2aba594a92af7cfff8c08f6477" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33025 } } }
I20260618 23:19:45.775930 6943 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477 [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:45.775956 6944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477 [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:45.776208 6952 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:19:45.776975 6952 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:19:45.778689 6959 mvcc.cc:205] Tried to move back new op lower bound from 7298354322547335168 to 7298354322536357888. Current Snapshot: MvccSnapshot[applied={T|T < 7298354322547335168}]
I20260618 23:19:45.779249 6952 catalog_manager.cc:1347] Generated new cluster ID: 098366d285ce4bcf874ec555e0ff004d
I20260618 23:19:45.779306 6952 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 18 23:19:45 dist-test-slave-r9ct krb5kdc[6856](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824785, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:45.785486 6941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:45.772434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57768 (local address 127.3.217.190:33025)
0618 23:19:45.772687 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:45.772697 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:45.772750 (+ 53us) server_negotiation.cc:407] Connection header received
0618 23:19:45.773231 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:45.773241 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:45.773303 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:45.773532 (+ 229us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:45.774301 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:45.775851 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:45.777387 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:45.778108 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:45.780147 (+ 2039us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:45.781256 (+ 1109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:45.781259 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:45.781260 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:45.781271 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:45.783856 (+ 2585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:45.784237 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:45.784240 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:45.784240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:45.784351 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:45.784559 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:45.784560 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:45.784560 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:45.784855 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:45.785018 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:45.785116 (+ 98us) server_negotiation.cc:299] Negotiation successful
0618 23:19:45.785253 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":75,"threads_started":1}
I20260618 23:19:45.786616 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:19:45.786854 6952 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:19:45.787643 6952 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:19:45.796785 6952 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9ddb4d2aba594a92af7cfff8c08f6477: Generated new TSK 0
I20260618 23:19:45.796974 6952 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:19:45.804234 6941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:45.800147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57784 (local address 127.3.217.190:33025)
0618 23:19:45.800214 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:45.800216 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:45.800386 (+ 170us) server_negotiation.cc:407] Connection header received
0618 23:19:45.800455 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:45.800455 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:45.800465 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:45.800521 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:45.800989 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:45.801520 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:45.802595 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:45.802911 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:45.802977 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:45.803674 (+ 697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:45.803675 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:45.803676 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:19:45.803925 (+ 249us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:45.803942 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:19:45.803948 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:45.804019 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:45.804098 (+ 79us) server_negotiation.cc:299] Negotiation successful
0618 23:19:45.804121 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260618 23:19:45.806942 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 6869
2026-06-18T23:19:45Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1402 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:19:45 dist-test-slave-r9ct krb5kdc[6970](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:19:45 dist-test-slave-r9ct krb5kdc[6970](info): set up 2 sockets
Jun 18 23:19:45 dist-test-slave-r9ct krb5kdc[6970](info): commencing operation
krb5kdc: starting...
W20260618 23:19:46.955070 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:19:47 dist-test-slave-r9ct krb5kdc[6970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824787, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:19:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:19:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:19:47.090920 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:41679
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:42859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:41679
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:47.177043 6983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:47.177318 6983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:47.177361 6983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:47.178669 6983 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:19:47.178786 6983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:47.178851 6983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:47.178900 6983 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:19:47.178933 6983 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:19:47.180984 6983 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:42859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:41679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:41679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6983
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:47.181315 6983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:47.181602 6983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:47.187631 6991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:47.188369 6988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:47.188472 6989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:47.188642 6983 server_base.cc:1034] running on GCE node
I20260618 23:19:47.188920 6983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:47.189518 6983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:47.190805 6983 hybrid_clock.cc:648] HybridClock initialized: now 1781824787190723 us; error 97 us; skew 500 ppm
Jun 18 23:19:47 dist-test-slave-r9ct krb5kdc[6970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824787, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:47.193881 6983 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:19:47.194444 6983 webserver.cc:460] Webserver started at http://127.3.217.190:35479/ using document root <none> and password file <none>
I20260618 23:19:47.194921 6983 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:47.195019 6983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:47.195179 6983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:47.196346 6983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "a7966d30ccf84aef8037826b0872ccee"
format_stamp: "Formatted at 2026-06-18 23:19:47 on dist-test-slave-r9ct"
server_key: "26017f8912f72ffc1eecad00d16acc26"
server_key_iv: "44c57dfc02686b8b5aed31ee532207ce"
server_key_version: "encryptionkey@0"
I20260618 23:19:47.196713 6983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "a7966d30ccf84aef8037826b0872ccee"
format_stamp: "Formatted at 2026-06-18 23:19:47 on dist-test-slave-r9ct"
server_key: "26017f8912f72ffc1eecad00d16acc26"
server_key_iv: "44c57dfc02686b8b5aed31ee532207ce"
server_key_version: "encryptionkey@0"
I20260618 23:19:47.198287 6983 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:19:47.199343 6998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:47.199643 6983 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260618 23:19:47.199752 6983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "a7966d30ccf84aef8037826b0872ccee"
format_stamp: "Formatted at 2026-06-18 23:19:47 on dist-test-slave-r9ct"
server_key: "26017f8912f72ffc1eecad00d16acc26"
server_key_iv: "44c57dfc02686b8b5aed31ee532207ce"
server_key_version: "encryptionkey@0"
I20260618 23:19:47.199836 6983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:47.207240 6983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:47.209806 6983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:47.209981 6983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:47.214124 6983 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:41679
I20260618 23:19:47.214159 7050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:41679 every 8 connection(s)
I20260618 23:19:47.214536 6983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:19:47.215538 7051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:47.216120 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 6983
I20260618 23:19:47.216262 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:19:47.216581 3942 external_mini_cluster.cc:1428] Setting key 0c2b55a338dd05d634c6872afb40e60c
I20260618 23:19:47.218844 7051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee: Bootstrap starting.
I20260618 23:19:47.219900 7051 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:47.220471 7051 log.cc:824] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:47.221346 7051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee: No bootstrap required, opened a new log
Jun 18 23:19:47 dist-test-slave-r9ct krb5kdc[6970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824787, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:47.223785 7051 raft_consensus.cc:348] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7966d30ccf84aef8037826b0872ccee" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41679 } }
I20260618 23:19:47.223946 7051 raft_consensus.cc:374] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:47.223995 7051 raft_consensus.cc:729] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7966d30ccf84aef8037826b0872ccee, State: Initialized, Role: FOLLOWER
I20260618 23:19:47.224150 7051 consensus_queue.cc:260] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7966d30ccf84aef8037826b0872ccee" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41679 } }
I20260618 23:19:47.224267 7051 raft_consensus.cc:388] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:19:47.224319 7051 raft_consensus.cc:482] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:19:47.224375 7051 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:47.225265 7051 raft_consensus.cc:504] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7966d30ccf84aef8037826b0872ccee" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41679 } }
I20260618 23:19:47.225389 7051 leader_election.cc:302] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a7966d30ccf84aef8037826b0872ccee; no voters:
I20260618 23:19:47.225603 7051 leader_election.cc:288] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:19:47.225661 7056 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:47.225873 7056 raft_consensus.cc:686] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee [term 1 LEADER]: Becoming Leader. State: Replica: a7966d30ccf84aef8037826b0872ccee, State: Running, Role: LEADER
I20260618 23:19:47.225948 7051 sys_catalog.cc:564] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:19:47.225970 7056 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7966d30ccf84aef8037826b0872ccee" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41679 } }
I20260618 23:19:47.226289 7057 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a7966d30ccf84aef8037826b0872ccee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7966d30ccf84aef8037826b0872ccee" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41679 } } }
I20260618 23:19:47.226284 7058 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee [sys.catalog]: SysCatalogTable state changed. Reason: New leader a7966d30ccf84aef8037826b0872ccee. Latest consensus state: current_term: 1 leader_uuid: "a7966d30ccf84aef8037826b0872ccee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7966d30ccf84aef8037826b0872ccee" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41679 } } }
I20260618 23:19:47.226384 7057 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:47.226388 7058 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:47.226608 7062 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:19:47.227147 7062 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:19:47.228724 7062 catalog_manager.cc:1347] Generated new cluster ID: d2d0e1d071b0401d8a0f392f0d820d83
I20260618 23:19:47.228776 7062 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:19:47.229547 7054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:47.217165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52346 (local address 127.3.217.190:41679)
0618 23:19:47.217317 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:47.217325 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:47.217349 (+ 24us) server_negotiation.cc:407] Connection header received
0618 23:19:47.217767 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:47.217773 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:47.217818 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:47.217934 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:47.218873 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:47.219791 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:47.221088 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:47.221767 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:47.221905 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:47.224503 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:47.224507 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:47.224507 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:47.224520 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:47.227473 (+ 2953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:47.227926 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:47.227979 (+ 53us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:47.227980 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:47.228111 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:47.228403 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:47.228404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:47.228404 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:47.228716 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:47.228868 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:47.229217 (+ 349us) server_negotiation.cc:299] Negotiation successful
0618 23:19:47.229358 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":77,"threads_started":1}
I20260618 23:19:47.243378 7062 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:19:47.244107 7062 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:19:47.251507 7062 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a7966d30ccf84aef8037826b0872ccee: Generated new TSK 0
I20260618 23:19:47.251694 7062 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.217.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
I20260618 23:19:47.287294 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:41679
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:42859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:47.390425 7077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:47.390700 7077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:47.390758 7077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:47.391987 7077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:47.392057 7077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:47.392107 7077 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:19:47.393626 7077 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:42859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:41679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:47.393899 7077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:47.394135 7077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:47.399827 7082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:47.399931 7083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:47.399922 7085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:47.400556 7077 server_base.cc:1034] running on GCE node
I20260618 23:19:47.400767 7077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:47.401008 7077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:47.402217 7077 hybrid_clock.cc:648] HybridClock initialized: now 1781824787402206 us; error 29 us; skew 500 ppm
Jun 18 23:19:47 dist-test-slave-r9ct krb5kdc[6970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824787, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:47.405452 7077 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:19:47.406031 7077 webserver.cc:460] Webserver started at http://127.3.217.129:41095/ using document root <none> and password file <none>
I20260618 23:19:47.406281 7077 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:47.406363 7077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:47.406514 7077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:47.407728 7077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "3f5b61b27aac43cf8d24165bf1664a9d"
format_stamp: "Formatted at 2026-06-18 23:19:47 on dist-test-slave-r9ct"
server_key: "12932a8dbddfe2abe2d17c2d8257ae1b"
server_key_iv: "c793f5bb03556e2de679af0a8636c273"
server_key_version: "encryptionkey@0"
I20260618 23:19:47.408135 7077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "3f5b61b27aac43cf8d24165bf1664a9d"
format_stamp: "Formatted at 2026-06-18 23:19:47 on dist-test-slave-r9ct"
server_key: "12932a8dbddfe2abe2d17c2d8257ae1b"
server_key_iv: "c793f5bb03556e2de679af0a8636c273"
server_key_version: "encryptionkey@0"
I20260618 23:19:47.409904 7077 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260618 23:19:47.411208 7092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:47.411680 7077 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:47.411800 7077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "3f5b61b27aac43cf8d24165bf1664a9d"
format_stamp: "Formatted at 2026-06-18 23:19:47 on dist-test-slave-r9ct"
server_key: "12932a8dbddfe2abe2d17c2d8257ae1b"
server_key_iv: "c793f5bb03556e2de679af0a8636c273"
server_key_version: "encryptionkey@0"
I20260618 23:19:47.411886 7077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:47.429342 7077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:47.432597 7077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:47.432858 7077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:47.433148 7077 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:47.433771 7077 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:47.433837 7077 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:47.433881 7077 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:47.433913 7077 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:47.442272 7077 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:45265
I20260618 23:19:47.442314 7205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:45265 every 8 connection(s)
I20260618 23:19:47.443334 7077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:19:47.445953 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 7077
I20260618 23:19:47.446069 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:19:47.446282 3942 external_mini_cluster.cc:1428] Setting key 38b900a797f5c881c8fb5607a87d8431
Jun 18 23:19:47 dist-test-slave-r9ct krb5kdc[6970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824787, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.3.217.130@KRBTEST.COM; defaulting to no policy
I20260618 23:19:47.457072 7054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:47.444427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:36991 (local address 127.3.217.190:41679)
0618 23:19:47.444501 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:47.444503 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:47.444612 (+ 109us) server_negotiation.cc:407] Connection header received
0618 23:19:47.445234 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:47.445236 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:47.445249 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:47.445342 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:47.446741 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:47.447773 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:47.449431 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:47.449904 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:47.450027 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:47.453129 (+ 3102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:47.453131 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:47.453132 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:47.453141 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:47.455044 (+ 1903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:47.455773 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:47.455774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:47.455775 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:47.455841 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:47.456243 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:47.456244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:47.456244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:47.456476 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:47.456562 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:47.456862 (+ 300us) server_negotiation.cc:299] Negotiation successful
0618 23:19:47.456962 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260618 23:19:47.457297 7208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:47.444324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:41679 (local address 127.3.217.129:36991)
0618 23:19:47.444500 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:47.444539 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:47.445075 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:47.445467 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:47.445470 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:47.446278 (+ 808us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:47.446575 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:47.446581 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:47.447910 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:47.447911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:47.449303 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:47.449306 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:47.450046 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:47.450047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:47.450222 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:47.451050 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:47.451061 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:47.453005 (+ 1944us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:47.455156 (+ 2151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:47.455163 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:47.455166 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:47.455656 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:47.456025 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:47.456026 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:47.456026 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:47.456161 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:47.456552 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:47.456559 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:47.456720 (+ 161us) client_negotiation.cc:769] Sending connection context
0618 23:19:47.456839 (+ 119us) client_negotiation.cc:240] Negotiation successful
0618 23:19:47.457033 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":78,"threads_started":1}
I20260618 23:19:47.458153 7206 heartbeater.cc:347] Connected to a master server at 127.3.217.190:41679
I20260618 23:19:47.458384 7206 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:47.458652 7206 heartbeater.cc:511] Master 127.3.217.190:41679 requested a full tablet report, sending...
I20260618 23:19:47.459476 7015 ts_manager.cc:194] Registered new tserver with Master: 3f5b61b27aac43cf8d24165bf1664a9d (127.3.217.129:45265)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.130@KRBTEST.COM" created.
I20260618 23:19:47.460422 7015 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:36991
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
I20260618 23:19:47.484549 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:41679
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:42859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:47.598263 7211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:47.598610 7211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:47.598644 7211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:47.600131 7211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:47.600188 7211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:47.600402 7211 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:19:47.604066 7211 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:42859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:41679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7211
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:47.604318 7211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:47.604606 7211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260618 23:19:47.611121 7211 server_base.cc:1034] running on GCE node
W20260618 23:19:47.611091 7216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:47.611068 7217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:47.611060 7219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:47.611637 7211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:47.611960 7211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:47.613160 7211 hybrid_clock.cc:648] HybridClock initialized: now 1781824787613147 us; error 31 us; skew 500 ppm
Jun 18 23:19:47 dist-test-slave-r9ct krb5kdc[6970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824787, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:47.616758 7211 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:19:47.617261 7211 webserver.cc:460] Webserver started at http://127.3.217.130:44327/ using document root <none> and password file <none>
I20260618 23:19:47.617544 7211 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:47.617594 7211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:47.617758 7211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:47.619189 7211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "bea565df8c9542b6856201a33ef7ec83"
format_stamp: "Formatted at 2026-06-18 23:19:47 on dist-test-slave-r9ct"
server_key: "fe406f05b1223a762ff4674a9036a49c"
server_key_iv: "c277cc62a48c65a01ed6ca32560df471"
server_key_version: "encryptionkey@0"
I20260618 23:19:47.619642 7211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "bea565df8c9542b6856201a33ef7ec83"
format_stamp: "Formatted at 2026-06-18 23:19:47 on dist-test-slave-r9ct"
server_key: "fe406f05b1223a762ff4674a9036a49c"
server_key_iv: "c277cc62a48c65a01ed6ca32560df471"
server_key_version: "encryptionkey@0"
I20260618 23:19:47.621526 7211 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260618 23:19:47.622690 7226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:47.623311 7211 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:47.623543 7211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "bea565df8c9542b6856201a33ef7ec83"
format_stamp: "Formatted at 2026-06-18 23:19:47 on dist-test-slave-r9ct"
server_key: "fe406f05b1223a762ff4674a9036a49c"
server_key_iv: "c277cc62a48c65a01ed6ca32560df471"
server_key_version: "encryptionkey@0"
I20260618 23:19:47.623639 7211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:47.644119 7211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:47.646428 7211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:47.646593 7211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:47.646957 7211 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:47.647300 7211 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:47.647334 7211 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:47.647357 7211 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:47.647399 7211 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:47.655412 7211 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:42593
I20260618 23:19:47.655449 7339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:42593 every 8 connection(s)
I20260618 23:19:47.655818 7211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:19:47.661818 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 7211
I20260618 23:19:47.661968 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:19:47.662235 3942 external_mini_cluster.cc:1428] Setting key d46a452f9b08105c05de4d60ba1c8eb6
Jun 18 23:19:47 dist-test-slave-r9ct krb5kdc[6970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824787, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:47.667898 7054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:47.656629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:44595 (local address 127.3.217.190:41679)
0618 23:19:47.656745 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:47.656754 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:47.656894 (+ 140us) server_negotiation.cc:407] Connection header received
0618 23:19:47.657442 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:47.657443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:47.657460 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:47.657561 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:47.658542 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:47.659097 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:47.660247 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:47.660461 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:47.660530 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:47.664007 (+ 3477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:47.664008 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:47.664009 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:47.664016 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:47.665662 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:47.666314 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:47.666334 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:47.666335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:47.666426 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:47.666965 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:47.666966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:47.666967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:47.667123 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:47.667276 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:47.667644 (+ 368us) server_negotiation.cc:299] Negotiation successful
0618 23:19:47.667781 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260618 23:19:47.668164 7342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:47.656589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:41679 (local address 127.3.217.130:44595)
0618 23:19:47.656757 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:47.656799 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:47.657308 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:47.657662 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:47.657665 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:47.658226 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:47.658422 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:47.658427 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:47.659316 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:47.659317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:47.660150 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:47.660151 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:47.660564 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:47.660565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:47.660680 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:47.661304 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:47.661316 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:47.663859 (+ 2543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:47.665773 (+ 1914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:47.665780 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:47.665783 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:47.666103 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:47.666639 (+ 536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:47.666641 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:47.666641 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:47.666875 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:47.667260 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:47.667268 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:47.667484 (+ 216us) client_negotiation.cc:769] Sending connection context
0618 23:19:47.667621 (+ 137us) client_negotiation.cc:240] Negotiation successful
0618 23:19:47.667856 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":92,"threads_started":1}
I20260618 23:19:47.669283 7340 heartbeater.cc:347] Connected to a master server at 127.3.217.190:41679
I20260618 23:19:47.669431 7340 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:47.669919 7340 heartbeater.cc:511] Master 127.3.217.190:41679 requested a full tablet report, sending...
I20260618 23:19:47.670686 7015 ts_manager.cc:194] Registered new tserver with Master: bea565df8c9542b6856201a33ef7ec83 (127.3.217.130:42593)
I20260618 23:19:47.671145 7015 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:44595
WARNING: no policy specified for kudu/127.3.217.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
I20260618 23:19:47.695317 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:41679
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:42859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:47.788273 7345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:47.788537 7345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:47.788569 7345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:47.790058 7345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:47.790115 7345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:47.790146 7345 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:19:47.791937 7345 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:42859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:41679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:47.792225 7345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:47.792479 7345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:47.798272 7350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:47.798372 7351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:47.798403 7353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:47.798470 7345 server_base.cc:1034] running on GCE node
I20260618 23:19:47.798758 7345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:47.798987 7345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:47.800173 7345 hybrid_clock.cc:648] HybridClock initialized: now 1781824787800161 us; error 38 us; skew 500 ppm
Jun 18 23:19:47 dist-test-slave-r9ct krb5kdc[6970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824787, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:47.803468 7345 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:19:47.804198 7345 webserver.cc:460] Webserver started at http://127.3.217.131:42179/ using document root <none> and password file <none>
I20260618 23:19:47.804451 7345 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:47.804522 7345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:47.804664 7345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:47.805757 7345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "c3f59f9ac924446aa1b1113cf2a1675f"
format_stamp: "Formatted at 2026-06-18 23:19:47 on dist-test-slave-r9ct"
server_key: "6777296c4a8996d5463f26dd003ec431"
server_key_iv: "b950f93805a3b959d976aa37d3e36594"
server_key_version: "encryptionkey@0"
I20260618 23:19:47.806147 7345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "c3f59f9ac924446aa1b1113cf2a1675f"
format_stamp: "Formatted at 2026-06-18 23:19:47 on dist-test-slave-r9ct"
server_key: "6777296c4a8996d5463f26dd003ec431"
server_key_iv: "b950f93805a3b959d976aa37d3e36594"
server_key_version: "encryptionkey@0"
I20260618 23:19:47.808053 7345 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260618 23:19:47.809093 7360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:47.809393 7345 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:47.809545 7345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "c3f59f9ac924446aa1b1113cf2a1675f"
format_stamp: "Formatted at 2026-06-18 23:19:47 on dist-test-slave-r9ct"
server_key: "6777296c4a8996d5463f26dd003ec431"
server_key_iv: "b950f93805a3b959d976aa37d3e36594"
server_key_version: "encryptionkey@0"
I20260618 23:19:47.809631 7345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:47.821504 7345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:47.824273 7345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:47.824510 7345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:47.824786 7345 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:47.825172 7345 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:47.825233 7345 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:47.825281 7345 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:47.825321 7345 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:47.833631 7345 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:43637
I20260618 23:19:47.833690 7473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:43637 every 8 connection(s)
I20260618 23:19:47.834086 7345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
Jun 18 23:19:47 dist-test-slave-r9ct krb5kdc[6970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824787, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:47.841846 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 7345
I20260618 23:19:47.842005 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:19:47.842258 3942 external_mini_cluster.cc:1428] Setting key 4d5d034660a3bcff6c150cf72a14ee1b
I20260618 23:19:47.844328 7054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:47.834897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:51241 (local address 127.3.217.190:41679)
0618 23:19:47.834968 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:47.834970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:47.835097 (+ 127us) server_negotiation.cc:407] Connection header received
0618 23:19:47.835578 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:47.835579 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:47.835589 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:47.835659 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:47.836554 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:47.837039 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:47.838064 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:47.838314 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:47.838422 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:47.840677 (+ 2255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:47.840678 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:47.840679 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:47.840686 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:47.842137 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:47.842863 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:47.842864 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:47.842865 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:47.843035 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:47.843431 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:47.843432 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:47.843433 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:47.843613 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:47.843693 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:47.844114 (+ 421us) server_negotiation.cc:299] Negotiation successful
0618 23:19:47.844249 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260618 23:19:47.844519 7476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:47.834835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:41679 (local address 127.3.217.131:51241)
0618 23:19:47.834981 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:47.835022 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:47.835487 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:47.835709 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:47.835712 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:47.836267 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:47.836454 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:47.836458 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:47.837145 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:47.837147 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:47.837921 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:47.837923 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:47.838447 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:47.838449 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:47.838562 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:47.839139 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:47.839146 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:47.840587 (+ 1441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:47.842256 (+ 1669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:47.842269 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:47.842273 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:47.842719 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:47.843178 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:47.843180 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:47.843180 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:47.843337 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:47.843735 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:47.843743 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:47.843920 (+ 177us) client_negotiation.cc:769] Sending connection context
0618 23:19:47.844023 (+ 103us) client_negotiation.cc:240] Negotiation successful
0618 23:19:47.844178 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":81,"threads_started":1}
I20260618 23:19:47.845152 7474 heartbeater.cc:347] Connected to a master server at 127.3.217.190:41679
I20260618 23:19:47.845237 7474 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:47.845378 7474 heartbeater.cc:511] Master 127.3.217.190:41679 requested a full tablet report, sending...
I20260618 23:19:47.845769 7015 ts_manager.cc:194] Registered new tserver with Master: c3f59f9ac924446aa1b1113cf2a1675f (127.3.217.131:43637)
I20260618 23:19:47.846298 7015 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:51241
I20260618 23:19:47.855002 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 18 23:19:47 dist-test-slave-r9ct krb5kdc[6970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824787, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Jun 18 23:19:47 dist-test-slave-r9ct krb5kdc[6970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824787, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:47.881549 7054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:47.873989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52352 (local address 127.3.217.190:41679)
0618 23:19:47.874069 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:47.874071 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:47.874176 (+ 105us) server_negotiation.cc:407] Connection header received
0618 23:19:47.874256 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:47.874257 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:47.874266 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:47.874335 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:47.874985 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:47.875480 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:47.876187 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:47.876381 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:47.876460 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:47.879067 (+ 2607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:47.879068 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:47.879069 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:47.879075 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:47.880430 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:47.880790 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:47.880791 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:47.880791 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:47.880847 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:47.881080 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:47.881081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:47.881081 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:47.881221 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:47.881301 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:47.881405 (+ 104us) server_negotiation.cc:299] Negotiation successful
0618 23:19:47.881469 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260618 23:19:47.881793 7015 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:52352
I20260618 23:19:47.882259 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 7077
I20260618 23:19:47.886929 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 7211
I20260618 23:19:47.891959 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 7345
I20260618 23:19:47.896214 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 6983
2026-06-18T23:19:47Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2093 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:19:47 dist-test-slave-r9ct krb5kdc[7486](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:19:47 dist-test-slave-r9ct krb5kdc[7486](info): set up 2 sockets
Jun 18 23:19:47 dist-test-slave-r9ct krb5kdc[7486](info): commencing operation
krb5kdc: starting...
W20260618 23:19:48.990689 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.072s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:19:49 dist-test-slave-r9ct krb5kdc[7486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:19:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:19:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:19:49.115094 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:42489
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:42489
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:49.201093 7499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:49.201396 7499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:49.201435 7499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:49.203316 7499 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:19:49.203374 7499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:49.203398 7499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:49.203426 7499 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:19:49.203451 7499 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:19:49.205812 7499 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:42489
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:42489
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:49.206090 7499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:49.206400 7499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:49.212917 7504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:49.212914 7505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:49.212922 7507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:49.213312 7499 server_base.cc:1034] running on GCE node
I20260618 23:19:49.213584 7499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:49.213920 7499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:49.215121 7499 hybrid_clock.cc:648] HybridClock initialized: now 1781824789214778 us; error 355 us; skew 500 ppm
Jun 18 23:19:49 dist-test-slave-r9ct krb5kdc[7486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824789, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:49.218561 7499 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:19:49.219153 7499 webserver.cc:460] Webserver started at http://127.3.217.190:43361/ using document root <none> and password file <none>
I20260618 23:19:49.219451 7499 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:49.219511 7499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:49.219655 7499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:49.221220 7499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "fc92db3ed8cd4ec5af433a8b4860722f"
format_stamp: "Formatted at 2026-06-18 23:19:49 on dist-test-slave-r9ct"
server_key: "b92a71dc698b6e40a22ef9aed50777f1"
server_key_iv: "12cf9605bdf1f53b8ecd85029272e3bc"
server_key_version: "encryptionkey@0"
I20260618 23:19:49.221652 7499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "fc92db3ed8cd4ec5af433a8b4860722f"
format_stamp: "Formatted at 2026-06-18 23:19:49 on dist-test-slave-r9ct"
server_key: "b92a71dc698b6e40a22ef9aed50777f1"
server_key_iv: "12cf9605bdf1f53b8ecd85029272e3bc"
server_key_version: "encryptionkey@0"
I20260618 23:19:49.224455 7499 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260618 23:19:49.225373 7514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:49.225553 7499 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:49.225649 7499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "fc92db3ed8cd4ec5af433a8b4860722f"
format_stamp: "Formatted at 2026-06-18 23:19:49 on dist-test-slave-r9ct"
server_key: "b92a71dc698b6e40a22ef9aed50777f1"
server_key_iv: "12cf9605bdf1f53b8ecd85029272e3bc"
server_key_version: "encryptionkey@0"
I20260618 23:19:49.225735 7499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:49.254544 7499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:49.257545 7499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:49.257735 7499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:49.262228 7499 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:42489
I20260618 23:19:49.262264 7566 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:42489 every 8 connection(s)
I20260618 23:19:49.262812 7499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:19:49.263517 7567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:49.265754 7567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f: Bootstrap starting.
I20260618 23:19:49.266335 7567 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:49.266621 7567 log.cc:824] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:49.267681 7567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f: No bootstrap required, opened a new log
I20260618 23:19:49.269932 7567 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc92db3ed8cd4ec5af433a8b4860722f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42489 } }
I20260618 23:19:49.270084 7567 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:49.270107 7567 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc92db3ed8cd4ec5af433a8b4860722f, State: Initialized, Role: FOLLOWER
I20260618 23:19:49.270279 7567 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc92db3ed8cd4ec5af433a8b4860722f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42489 } }
I20260618 23:19:49.270381 7567 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:19:49.270422 7567 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:19:49.270462 7567 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:49.270562 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 7499
I20260618 23:19:49.270687 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:19:49.270887 3942 external_mini_cluster.cc:1428] Setting key 93005bf643a1446a8804d384ff2d5ddb
I20260618 23:19:49.271849 7567 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc92db3ed8cd4ec5af433a8b4860722f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42489 } }
I20260618 23:19:49.271970 7567 leader_election.cc:302] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc92db3ed8cd4ec5af433a8b4860722f; no voters:
I20260618 23:19:49.272119 7567 leader_election.cc:288] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:19:49.272164 7572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:49.272307 7572 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f [term 1 LEADER]: Becoming Leader. State: Replica: fc92db3ed8cd4ec5af433a8b4860722f, State: Running, Role: LEADER
I20260618 23:19:49.272395 7572 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc92db3ed8cd4ec5af433a8b4860722f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42489 } }
I20260618 23:19:49.272460 7567 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:19:49.272718 7572 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc92db3ed8cd4ec5af433a8b4860722f. Latest consensus state: current_term: 1 leader_uuid: "fc92db3ed8cd4ec5af433a8b4860722f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc92db3ed8cd4ec5af433a8b4860722f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42489 } } }
I20260618 23:19:49.272809 7572 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:49.272732 7574 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc92db3ed8cd4ec5af433a8b4860722f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc92db3ed8cd4ec5af433a8b4860722f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42489 } } }
I20260618 23:19:49.273029 7574 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:49.273377 7577 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:19:49.273907 7577 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:19:49.275476 7577 catalog_manager.cc:1347] Generated new cluster ID: 4e8ce484e30c41c4ba44afb0cda4ee0d
I20260618 23:19:49.275527 7577 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 18 23:19:49 dist-test-slave-r9ct krb5kdc[7486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:49.283308 7571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:49.271385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40124 (local address 127.3.217.190:42489)
0618 23:19:49.271624 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:49.271634 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:49.271678 (+ 44us) server_negotiation.cc:407] Connection header received
0618 23:19:49.271796 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:49.271803 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:49.271859 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:49.272024 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:49.273148 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:49.274746 (+ 1598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:49.275766 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:49.276386 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:49.276478 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:49.279226 (+ 2748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:49.279231 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:49.279231 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:49.279243 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:49.281693 (+ 2450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:49.282057 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:49.282060 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:49.282061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:49.282169 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:49.282362 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:49.282363 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:49.282363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:49.282658 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:49.282889 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:49.282959 (+ 70us) server_negotiation.cc:299] Negotiation successful
0618 23:19:49.283092 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":129,"threads_started":1}
I20260618 23:19:49.285101 7577 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:19:49.285588 7577 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:19:49.289502 7577 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc92db3ed8cd4ec5af433a8b4860722f: Generated new TSK 0
I20260618 23:19:49.289685 7577 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.217.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
I20260618 23:19:49.323163 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:42489
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:49.407521 7593 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:49.407707 7593 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:49.407729 7593 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:49.408806 7593 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:49.408855 7593 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:49.408883 7593 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:19:49.410351 7593 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:42489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7593
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:49.410521 7593 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:49.410682 7593 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260618 23:19:49.416388 7593 server_base.cc:1034] running on GCE node
W20260618 23:19:49.416354 7598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:49.416378 7599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:49.416370 7601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:49.416729 7593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:49.416957 7593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:49.418126 7593 hybrid_clock.cc:648] HybridClock initialized: now 1781824789418101 us; error 40 us; skew 500 ppm
Jun 18 23:19:49 dist-test-slave-r9ct krb5kdc[7486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824789, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:49.421146 7593 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:19:49.421615 7593 webserver.cc:460] Webserver started at http://127.3.217.129:35101/ using document root <none> and password file <none>
I20260618 23:19:49.421840 7593 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:49.421911 7593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:49.422060 7593 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:49.423162 7593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "43fa36d2f42c4e32959b74ca1c075ec6"
format_stamp: "Formatted at 2026-06-18 23:19:49 on dist-test-slave-r9ct"
server_key: "fca9062f291698568341aa5a591171c0"
server_key_iv: "397981f28daa8604b503f0e04d1c6eee"
server_key_version: "encryptionkey@0"
I20260618 23:19:49.423527 7593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "43fa36d2f42c4e32959b74ca1c075ec6"
format_stamp: "Formatted at 2026-06-18 23:19:49 on dist-test-slave-r9ct"
server_key: "fca9062f291698568341aa5a591171c0"
server_key_iv: "397981f28daa8604b503f0e04d1c6eee"
server_key_version: "encryptionkey@0"
I20260618 23:19:49.425128 7593 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260618 23:19:49.426321 7608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:49.426694 7593 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:49.426918 7593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "43fa36d2f42c4e32959b74ca1c075ec6"
format_stamp: "Formatted at 2026-06-18 23:19:49 on dist-test-slave-r9ct"
server_key: "fca9062f291698568341aa5a591171c0"
server_key_iv: "397981f28daa8604b503f0e04d1c6eee"
server_key_version: "encryptionkey@0"
I20260618 23:19:49.427008 7593 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:49.451413 7593 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:49.453899 7593 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:49.454089 7593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:49.454337 7593 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:49.454664 7593 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:49.454720 7593 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:49.454787 7593 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:49.454849 7593 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:49.460846 7593 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:41463
I20260618 23:19:49.460966 7721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:41463 every 8 connection(s)
I20260618 23:19:49.461251 7593 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:19:49.468495 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 7593
I20260618 23:19:49.468618 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:19:49.468796 3942 external_mini_cluster.cc:1428] Setting key d6832c05033cb27ca96b8070733b5bea
Jun 18 23:19:49 dist-test-slave-r9ct krb5kdc[7486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824789, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:49.472922 7571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:49.462511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:43317 (local address 127.3.217.190:42489)
0618 23:19:49.462617 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:49.462673 (+ 56us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:49.462834 (+ 161us) server_negotiation.cc:407] Connection header received
0618 23:19:49.464154 (+ 1320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:49.464157 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:49.464171 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:49.464230 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:49.464958 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:49.465589 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:49.467116 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:49.467350 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:49.467448 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:49.469993 (+ 2545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:49.469995 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:49.469995 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:49.470005 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:49.471503 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:49.471959 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:49.471960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:49.471961 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:49.472021 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:49.472268 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:49.472269 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:49.472270 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:49.472392 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:49.472468 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:49.472741 (+ 273us) server_negotiation.cc:299] Negotiation successful
0618 23:19:49.472834 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260618 23:19:49.473167 7724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:49.462341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:42489 (local address 127.3.217.129:43317)
0618 23:19:49.462624 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:49.462686 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:49.463991 (+ 1305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:49.464301 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:49.464305 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:49.464586 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:49.464769 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:49.464772 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:49.465856 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:49.465858 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:49.466971 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:49.466975 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:49.467469 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:49.467471 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:49.467594 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:49.468119 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:49.468129 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:49.469872 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:49.471610 (+ 1738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:49.471617 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:49.471619 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:49.471869 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:49.472087 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:49.472088 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:49.472088 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:49.472201 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:49.472459 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:49.472465 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:49.472604 (+ 139us) client_negotiation.cc:769] Sending connection context
0618 23:19:49.472708 (+ 104us) client_negotiation.cc:240] Negotiation successful
0618 23:19:49.472867 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":138,"threads_started":1}
I20260618 23:19:49.473785 7722 heartbeater.cc:347] Connected to a master server at 127.3.217.190:42489
I20260618 23:19:49.473905 7722 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:49.474130 7722 heartbeater.cc:511] Master 127.3.217.190:42489 requested a full tablet report, sending...
I20260618 23:19:49.474658 7531 ts_manager.cc:194] Registered new tserver with Master: 43fa36d2f42c4e32959b74ca1c075ec6 (127.3.217.129:41463)
I20260618 23:19:49.475270 7531 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:43317
WARNING: no policy specified for kudu/127.3.217.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
I20260618 23:19:49.494326 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:42489
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:49.577358 7727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:49.577559 7727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:49.577582 7727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:49.578943 7727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:49.578989 7727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:49.579015 7727 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:19:49.580504 7727 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:42489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:49.580740 7727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:49.580977 7727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:49.586234 7732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:49.586290 7733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:49.586253 7735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:49.586853 7727 server_base.cc:1034] running on GCE node
I20260618 23:19:49.587332 7727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:49.587679 7727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:49.588932 7727 hybrid_clock.cc:648] HybridClock initialized: now 1781824789588885 us; error 61 us; skew 500 ppm
Jun 18 23:19:49 dist-test-slave-r9ct krb5kdc[7486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824789, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:49.591964 7727 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:19:49.592502 7727 webserver.cc:460] Webserver started at http://127.3.217.130:35421/ using document root <none> and password file <none>
I20260618 23:19:49.592731 7727 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:49.592775 7727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:49.592929 7727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:49.593930 7727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "d976b58bcb3344938d42c8a8648e6b99"
format_stamp: "Formatted at 2026-06-18 23:19:49 on dist-test-slave-r9ct"
server_key: "d6bea637dfeababbfe721c0596345323"
server_key_iv: "b1eca8a45c88a40e06d7bce147775676"
server_key_version: "encryptionkey@0"
I20260618 23:19:49.594285 7727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "d976b58bcb3344938d42c8a8648e6b99"
format_stamp: "Formatted at 2026-06-18 23:19:49 on dist-test-slave-r9ct"
server_key: "d6bea637dfeababbfe721c0596345323"
server_key_iv: "b1eca8a45c88a40e06d7bce147775676"
server_key_version: "encryptionkey@0"
I20260618 23:19:49.595690 7727 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260618 23:19:49.596590 7742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:49.596774 7727 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:19:49.596865 7727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "d976b58bcb3344938d42c8a8648e6b99"
format_stamp: "Formatted at 2026-06-18 23:19:49 on dist-test-slave-r9ct"
server_key: "d6bea637dfeababbfe721c0596345323"
server_key_iv: "b1eca8a45c88a40e06d7bce147775676"
server_key_version: "encryptionkey@0"
I20260618 23:19:49.596930 7727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:49.607121 7727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:49.609242 7727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:49.609369 7727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:49.609544 7727 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:49.609831 7727 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:49.609862 7727 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:49.609884 7727 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:49.609927 7727 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:49.617136 7727 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:37653
I20260618 23:19:49.617233 7855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:37653 every 8 connection(s)
I20260618 23:19:49.617559 7727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:19:49.619419 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 7727
I20260618 23:19:49.619551 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:19:49.619745 3942 external_mini_cluster.cc:1428] Setting key fc948c1df5c09091d458362fbc1e7909
Jun 18 23:19:49 dist-test-slave-r9ct krb5kdc[7486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824789, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.3.217.131@KRBTEST.COM; defaulting to no policy
I20260618 23:19:49.630146 7571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:49.618332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:33635 (local address 127.3.217.190:42489)
0618 23:19:49.618381 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:49.618383 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:49.618610 (+ 227us) server_negotiation.cc:407] Connection header received
0618 23:19:49.620001 (+ 1391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:49.620002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:49.620016 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:49.620079 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:49.620908 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:49.621399 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:49.622734 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:49.623109 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:49.623192 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:49.626088 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:49.626091 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:49.626091 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:49.626099 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:49.627769 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:49.628191 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:49.628192 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:49.628193 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:49.628248 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:49.628892 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:49.628897 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:49.628897 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:49.629411 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:49.629536 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:49.629958 (+ 422us) server_negotiation.cc:299] Negotiation successful
0618 23:19:49.630076 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260618 23:19:49.630291 7858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:49.618297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:42489 (local address 127.3.217.130:33635)
0618 23:19:49.618460 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:49.618498 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:49.619856 (+ 1358us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:49.620157 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:49.620160 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:49.620541 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:49.620818 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:49.620824 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:49.621479 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:49.621480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:49.622627 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:49.622629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:49.623219 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:49.623220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:49.623327 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:49.623922 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:49.623934 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:49.625995 (+ 2061us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:49.627875 (+ 1880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:49.627886 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:49.627887 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:49.628109 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:49.628413 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:49.628477 (+ 64us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:49.628478 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:49.628715 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:49.629576 (+ 861us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:49.629582 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:49.629720 (+ 138us) client_negotiation.cc:769] Sending connection context
0618 23:19:49.629861 (+ 141us) client_negotiation.cc:240] Negotiation successful
0618 23:19:49.630065 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":96,"threads_started":1}
I20260618 23:19:49.630970 7856 heartbeater.cc:347] Connected to a master server at 127.3.217.190:42489
I20260618 23:19:49.631052 7856 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:49.631263 7856 heartbeater.cc:511] Master 127.3.217.190:42489 requested a full tablet report, sending...
I20260618 23:19:49.631711 7531 ts_manager.cc:194] Registered new tserver with Master: d976b58bcb3344938d42c8a8648e6b99 (127.3.217.130:37653)
I20260618 23:19:49.632320 7531 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:33635
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
I20260618 23:19:49.651714 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:42489
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:49.734805 7861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:49.735037 7861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:49.735074 7861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:49.736320 7861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:49.736397 7861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:49.736445 7861 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:19:49.738006 7861 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:42489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7861
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:49.738252 7861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:49.738472 7861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260618 23:19:49.743729 7861 server_base.cc:1034] running on GCE node
W20260618 23:19:49.743682 7867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:49.743688 7869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:49.743688 7866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:49.744146 7861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:49.744385 7861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:49.745671 7861 hybrid_clock.cc:648] HybridClock initialized: now 1781824789745534 us; error 69 us; skew 500 ppm
Jun 18 23:19:49 dist-test-slave-r9ct krb5kdc[7486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824789, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:49.748963 7861 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:19:49.749437 7861 webserver.cc:460] Webserver started at http://127.3.217.131:38247/ using document root <none> and password file <none>
I20260618 23:19:49.749663 7861 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:49.749732 7861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:49.749884 7861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:49.751753 7861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "b26d0b074be6451fa3b12c891f056194"
format_stamp: "Formatted at 2026-06-18 23:19:49 on dist-test-slave-r9ct"
server_key: "97c28e6d222646c8ead492b9ee604ceb"
server_key_iv: "96a538d7e4d00cd31bff0332b7a14b4d"
server_key_version: "encryptionkey@0"
I20260618 23:19:49.752171 7861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "b26d0b074be6451fa3b12c891f056194"
format_stamp: "Formatted at 2026-06-18 23:19:49 on dist-test-slave-r9ct"
server_key: "97c28e6d222646c8ead492b9ee604ceb"
server_key_iv: "96a538d7e4d00cd31bff0332b7a14b4d"
server_key_version: "encryptionkey@0"
I20260618 23:19:49.753854 7861 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:19:49.754997 7876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:49.755203 7861 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:49.755317 7861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "b26d0b074be6451fa3b12c891f056194"
format_stamp: "Formatted at 2026-06-18 23:19:49 on dist-test-slave-r9ct"
server_key: "97c28e6d222646c8ead492b9ee604ceb"
server_key_iv: "96a538d7e4d00cd31bff0332b7a14b4d"
server_key_version: "encryptionkey@0"
I20260618 23:19:49.755435 7861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:49.779047 7861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:49.782424 7861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:49.782596 7861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:49.782910 7861 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:49.783227 7861 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:49.783281 7861 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:49.783324 7861 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:49.783355 7861 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:49.789534 7861 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:34365
I20260618 23:19:49.789743 7989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:34365 every 8 connection(s)
I20260618 23:19:49.790278 7861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:19:49.797609 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 7861
I20260618 23:19:49.797732 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:19:49.797924 3942 external_mini_cluster.cc:1428] Setting key bde8a447080c6ce2c0feb893c44a66c1
Jun 18 23:19:49 dist-test-slave-r9ct krb5kdc[7486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824789, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:49.801776 7571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:49.791437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:58647 (local address 127.3.217.190:42489)
0618 23:19:49.791620 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:49.791622 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:49.791927 (+ 305us) server_negotiation.cc:407] Connection header received
0618 23:19:49.793130 (+ 1203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:49.793132 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:49.793145 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:49.793207 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:49.793897 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:49.794397 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:49.795687 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:49.796035 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:49.796265 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:49.798875 (+ 2610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:49.798877 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:49.798878 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:49.798885 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:49.800274 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:49.800761 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:49.800762 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:49.800762 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:49.800819 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:49.801088 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:49.801089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:49.801090 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:49.801212 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:49.801288 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:49.801580 (+ 292us) server_negotiation.cc:299] Negotiation successful
0618 23:19:49.801684 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140}
I20260618 23:19:49.801954 7992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:49.791341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:42489 (local address 127.3.217.131:58647)
0618 23:19:49.791661 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:49.791782 (+ 121us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:49.792984 (+ 1202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:49.793280 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:49.793288 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:49.793542 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:49.793771 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:49.793775 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:49.794490 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:49.794491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:49.795535 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:49.795538 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:49.796269 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:49.796270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:49.796405 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:49.796935 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:49.796943 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:49.798746 (+ 1803us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:49.800355 (+ 1609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:49.800361 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:49.800364 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:49.800678 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:49.800907 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:49.800908 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:49.800908 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:49.801021 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:49.801279 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:49.801285 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:49.801448 (+ 163us) client_negotiation.cc:769] Sending connection context
0618 23:19:49.801558 (+ 110us) client_negotiation.cc:240] Negotiation successful
0618 23:19:49.801713 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":95,"threads_started":1}
I20260618 23:19:49.802438 7990 heartbeater.cc:347] Connected to a master server at 127.3.217.190:42489
I20260618 23:19:49.802517 7990 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:49.802704 7990 heartbeater.cc:511] Master 127.3.217.190:42489 requested a full tablet report, sending...
I20260618 23:19:49.803133 7531 ts_manager.cc:194] Registered new tserver with Master: b26d0b074be6451fa3b12c891f056194 (127.3.217.131:34365)
I20260618 23:19:49.803486 7531 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:58647
I20260618 23:19:49.810782 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 18 23:19:49 dist-test-slave-r9ct krb5kdc[7486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 18 23:19:49 dist-test-slave-r9ct krb5kdc[7486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.129@KRBTEST.COM
I20260618 23:19:49.836726 7997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:49.827159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49342 (local address 127.3.217.129:41463)
0618 23:19:49.827318 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:49.827324 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:49.827335 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:19:49.827363 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:49.827365 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:49.827379 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:49.827446 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:49.828213 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:49.829195 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:49.830255 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:49.830698 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:49.830810 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:49.833461 (+ 2651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:49.833474 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:49.833474 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:49.833483 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:49.835241 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:49.835635 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:49.835654 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:49.835654 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:49.835726 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:49.835948 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:49.835949 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:49.835949 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:49.836107 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:49.836362 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:49.836446 (+ 84us) server_negotiation.cc:299] Negotiation successful
0618 23:19:49.836533 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":88,"threads_started":1}
Jun 18 23:19:49 dist-test-slave-r9ct krb5kdc[7486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:49.846242 7571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:49.838619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40132 (local address 127.3.217.190:42489)
0618 23:19:49.838802 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:49.838805 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:49.839043 (+ 238us) server_negotiation.cc:407] Connection header received
0618 23:19:49.839070 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:49.839071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:49.839081 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:49.839130 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:49.839573 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:49.840039 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:49.840741 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:49.840918 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:49.840981 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:49.843475 (+ 2494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:49.843476 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:49.843476 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:49.843483 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:49.845012 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:49.845383 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:49.845384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:49.845384 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:49.845441 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:49.845614 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:49.845615 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:49.845615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:49.845762 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:49.845835 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:49.846018 (+ 183us) server_negotiation.cc:299] Negotiation successful
0618 23:19:49.846130 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143}
W20260618 23:19:49.846442 7531 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40132
I20260618 23:19:49.846791 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 7593
I20260618 23:19:49.851442 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 7727
I20260618 23:19:49.855623 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 7861
I20260618 23:19:49.860410 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 7499
2026-06-18T23:19:49Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1964 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:19:49 dist-test-slave-r9ct krb5kdc[8002](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:19:49 dist-test-slave-r9ct krb5kdc[8002](info): set up 2 sockets
Jun 18 23:19:49 dist-test-slave-r9ct krb5kdc[8002](info): commencing operation
krb5kdc: starting...
W20260618 23:19:50.926643 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:19:51 dist-test-slave-r9ct krb5kdc[8002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:19:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:19:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:19:51.055142 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:46793
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:42655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:46793
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:51.136842 8015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:51.137055 8015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:51.137079 8015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:51.138219 8015 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:19:51.138259 8015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:51.138273 8015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:51.138286 8015 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:19:51.138298 8015 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:19:51.139789 8015 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:42655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:46793
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:46793
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8015
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:51.140043 8015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:51.140261 8015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:51.145299 8020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:51.145300 8021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:51.145300 8023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:51.145560 8015 server_base.cc:1034] running on GCE node
I20260618 23:19:51.146051 8015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:51.146385 8015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:51.147570 8015 hybrid_clock.cc:648] HybridClock initialized: now 1781824791147554 us; error 60 us; skew 500 ppm
Jun 18 23:19:51 dist-test-slave-r9ct krb5kdc[8002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824791, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:51.156325 8015 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:19:51.156754 8015 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:51.156824 8015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:51.156970 8015 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:51.158062 8015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "c5a4a6f0a7fb4b0d8e9f33199ab90843"
format_stamp: "Formatted at 2026-06-18 23:19:51 on dist-test-slave-r9ct"
server_key: "45e2f9bae1830adb481a37aaa670206d"
server_key_iv: "b6941dec4418d2b22ba1aa6267caea6b"
server_key_version: "encryptionkey@0"
I20260618 23:19:51.158433 8015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "c5a4a6f0a7fb4b0d8e9f33199ab90843"
format_stamp: "Formatted at 2026-06-18 23:19:51 on dist-test-slave-r9ct"
server_key: "45e2f9bae1830adb481a37aaa670206d"
server_key_iv: "b6941dec4418d2b22ba1aa6267caea6b"
server_key_version: "encryptionkey@0"
I20260618 23:19:51.160475 8015 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260618 23:19:51.161535 8029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:51.161855 8015 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:51.162027 8015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "c5a4a6f0a7fb4b0d8e9f33199ab90843"
format_stamp: "Formatted at 2026-06-18 23:19:51 on dist-test-slave-r9ct"
server_key: "45e2f9bae1830adb481a37aaa670206d"
server_key_iv: "b6941dec4418d2b22ba1aa6267caea6b"
server_key_version: "encryptionkey@0"
I20260618 23:19:51.162108 8015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:51.176208 8015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:51.178915 8015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:51.179133 8015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:51.184077 8015 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:46793
I20260618 23:19:51.184103 8081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:46793 every 8 connection(s)
I20260618 23:19:51.184402 8015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:19:51.185554 8082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:51.188459 8082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843: Bootstrap starting.
I20260618 23:19:51.189091 8082 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:51.189360 8082 log.cc:824] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:51.190393 8082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843: No bootstrap required, opened a new log
I20260618 23:19:51.190501 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 8015
I20260618 23:19:51.190644 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:19:51.190842 3942 external_mini_cluster.cc:1428] Setting key 6fc8d390cba920f162301d808c5a0a47
I20260618 23:19:51.193794 8082 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5a4a6f0a7fb4b0d8e9f33199ab90843" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 46793 } }
I20260618 23:19:51.193945 8082 raft_consensus.cc:374] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:51.193969 8082 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5a4a6f0a7fb4b0d8e9f33199ab90843, State: Initialized, Role: FOLLOWER
I20260618 23:19:51.194114 8082 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5a4a6f0a7fb4b0d8e9f33199ab90843" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 46793 } }
I20260618 23:19:51.194192 8082 raft_consensus.cc:388] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:19:51.194214 8082 raft_consensus.cc:482] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:19:51.194279 8082 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:51.194985 8082 raft_consensus.cc:504] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5a4a6f0a7fb4b0d8e9f33199ab90843" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 46793 } }
I20260618 23:19:51.195106 8082 leader_election.cc:302] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5a4a6f0a7fb4b0d8e9f33199ab90843; no voters:
I20260618 23:19:51.195288 8082 leader_election.cc:288] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:19:51.195324 8087 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:51.195430 8087 raft_consensus.cc:686] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843 [term 1 LEADER]: Becoming Leader. State: Replica: c5a4a6f0a7fb4b0d8e9f33199ab90843, State: Running, Role: LEADER
I20260618 23:19:51.195508 8087 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5a4a6f0a7fb4b0d8e9f33199ab90843" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 46793 } }
I20260618 23:19:51.195556 8082 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:19:51.195820 8087 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5a4a6f0a7fb4b0d8e9f33199ab90843. Latest consensus state: current_term: 1 leader_uuid: "c5a4a6f0a7fb4b0d8e9f33199ab90843" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5a4a6f0a7fb4b0d8e9f33199ab90843" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 46793 } } }
I20260618 23:19:51.195914 8087 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843 [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:51.196147 8089 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c5a4a6f0a7fb4b0d8e9f33199ab90843" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5a4a6f0a7fb4b0d8e9f33199ab90843" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 46793 } } }
I20260618 23:19:51.196275 8089 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843 [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:51.196451 8091 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:19:51.196969 8091 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Jun 18 23:19:51 dist-test-slave-r9ct krb5kdc[8002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:51.198500 8091 catalog_manager.cc:1347] Generated new cluster ID: c2333f3c608547b38a3b70b2dd1a59d9
I20260618 23:19:51.198550 8091 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:19:51.201802 8086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:51.191380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43934 (local address 127.3.217.190:46793)
0618 23:19:51.191570 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:51.191578 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:51.191603 (+ 25us) server_negotiation.cc:407] Connection header received
0618 23:19:51.192108 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:51.192114 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:51.192159 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:51.192271 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:51.193213 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.194198 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.195069 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.195696 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.195797 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:51.198691 (+ 2894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:51.198695 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:51.198695 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:51.198729 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:51.200365 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:51.200728 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:51.200730 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:51.200731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:51.200820 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:51.201031 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:51.201032 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:51.201032 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:51.201249 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:51.201406 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:51.201511 (+ 105us) server_negotiation.cc:299] Negotiation successful
0618 23:19:51.201640 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":101,"threads_started":1}
I20260618 23:19:51.214615 8091 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:19:51.215349 8091 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:19:51.230631 8091 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843: Generated new TSK 0
I20260618 23:19:51.230922 8091 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.217.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
I20260618 23:19:51.266597 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:46793
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:42655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:51.350078 8108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:51.350274 8108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:51.350297 8108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:51.351512 8108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:51.351553 8108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:51.351579 8108 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:19:51.353082 8108 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:42655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:46793
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8108
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:51.353314 8108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:51.353543 8108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:51.358762 8116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:51.358752 8113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:51.358829 8114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:51.358918 8108 server_base.cc:1034] running on GCE node
I20260618 23:19:51.359254 8108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:51.359535 8108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:51.360895 8108 hybrid_clock.cc:648] HybridClock initialized: now 1781824791360810 us; error 56 us; skew 500 ppm
Jun 18 23:19:51 dist-test-slave-r9ct krb5kdc[8002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824791, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:51.364518 8108 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:19:51.364951 8108 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:51.365039 8108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:51.365217 8108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:51.366382 8108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "67f372a7279d45eeb449afcf1ac3b586"
format_stamp: "Formatted at 2026-06-18 23:19:51 on dist-test-slave-r9ct"
server_key: "24e766b84af9783cb0eb8fc4d815263d"
server_key_iv: "b8faae3f29b95d824d52677240e288ee"
server_key_version: "encryptionkey@0"
I20260618 23:19:51.366842 8108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "67f372a7279d45eeb449afcf1ac3b586"
format_stamp: "Formatted at 2026-06-18 23:19:51 on dist-test-slave-r9ct"
server_key: "24e766b84af9783cb0eb8fc4d815263d"
server_key_iv: "b8faae3f29b95d824d52677240e288ee"
server_key_version: "encryptionkey@0"
I20260618 23:19:51.368467 8108 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:19:51.369324 8122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:51.369652 8108 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:51.369908 8108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "67f372a7279d45eeb449afcf1ac3b586"
format_stamp: "Formatted at 2026-06-18 23:19:51 on dist-test-slave-r9ct"
server_key: "24e766b84af9783cb0eb8fc4d815263d"
server_key_iv: "b8faae3f29b95d824d52677240e288ee"
server_key_version: "encryptionkey@0"
I20260618 23:19:51.369994 8108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:51.404239 8108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:51.406625 8108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:51.406824 8108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:51.407069 8108 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:51.407385 8108 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:51.407445 8108 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:51.407486 8108 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:51.407514 8108 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:51.413391 8108 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:38435
I20260618 23:19:51.413452 8235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:38435 every 8 connection(s)
I20260618 23:19:51.413693 8108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
Jun 18 23:19:51 dist-test-slave-r9ct krb5kdc[8002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824791, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:51.421960 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 8108
I20260618 23:19:51.422048 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:19:51.422225 3942 external_mini_cluster.cc:1428] Setting key 0ecd4c9260d352169ac1a5eef23f0c17
I20260618 23:19:51.423334 8086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:51.414383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:33225 (local address 127.3.217.190:46793)
0618 23:19:51.414455 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:51.414456 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:51.414652 (+ 196us) server_negotiation.cc:407] Connection header received
0618 23:19:51.415196 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:51.415197 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:51.415208 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:51.415263 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:51.416155 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.416655 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.417635 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.417836 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.417924 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:51.420232 (+ 2308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:51.420234 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:51.420234 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:51.420241 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:51.421829 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:51.422306 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:51.422308 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:51.422308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:51.422372 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:51.422653 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:51.422653 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:51.422654 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:51.422809 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:51.422880 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:51.423198 (+ 318us) server_negotiation.cc:299] Negotiation successful
0618 23:19:51.423270 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260618 23:19:51.423614 8238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:51.414347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:46793 (local address 127.3.217.129:33225)
0618 23:19:51.414532 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:51.414574 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:51.415088 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:51.415338 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:51.415342 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:51.415589 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:51.416049 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:51.416053 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.416749 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.416750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:51.417529 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:51.417530 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.417947 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.417948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:51.418061 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:51.418575 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:51.418583 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:51.420125 (+ 1542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:51.421924 (+ 1799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:51.421929 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:51.421931 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:51.422219 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:51.422463 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:51.422464 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:51.422465 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:51.422602 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:51.422892 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:51.422898 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:51.423051 (+ 153us) client_negotiation.cc:769] Sending connection context
0618 23:19:51.423170 (+ 119us) client_negotiation.cc:240] Negotiation successful
0618 23:19:51.423341 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":114,"threads_started":1}
I20260618 23:19:51.424435 8236 heartbeater.cc:347] Connected to a master server at 127.3.217.190:46793
I20260618 23:19:51.424546 8236 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:51.424713 8236 heartbeater.cc:511] Master 127.3.217.190:46793 requested a full tablet report, sending...
I20260618 23:19:51.425186 8046 ts_manager.cc:194] Registered new tserver with Master: 67f372a7279d45eeb449afcf1ac3b586 (127.3.217.129:38435)
I20260618 23:19:51.425776 8046 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:33225
WARNING: no policy specified for kudu/127.3.217.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
I20260618 23:19:51.450618 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:46793
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:42655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:51.532859 8241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:51.533186 8241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:51.533217 8241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:51.534832 8241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:51.534878 8241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:51.534910 8241 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:19:51.536708 8241 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:42655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:46793
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8241
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:51.536918 8241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:51.537091 8241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:51.542517 8246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:51.542650 8241 server_base.cc:1034] running on GCE node
W20260618 23:19:51.542513 8249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:51.542887 8247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:51.543128 8241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:51.543329 8241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:51.544490 8241 hybrid_clock.cc:648] HybridClock initialized: now 1781824791544481 us; error 34 us; skew 500 ppm
Jun 18 23:19:51 dist-test-slave-r9ct krb5kdc[8002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824791, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:51.547446 8241 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:19:51.547838 8241 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:51.547924 8241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:51.548063 8241 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:51.549089 8241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "e8a6468b9a3d4bdf9b102fdfc329b11f"
format_stamp: "Formatted at 2026-06-18 23:19:51 on dist-test-slave-r9ct"
server_key: "4ecbf5cc99dd91fc9a26143e49f5ddac"
server_key_iv: "c3bb22339569ccfdf29cb2695fa5d57b"
server_key_version: "encryptionkey@0"
I20260618 23:19:51.549451 8241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "e8a6468b9a3d4bdf9b102fdfc329b11f"
format_stamp: "Formatted at 2026-06-18 23:19:51 on dist-test-slave-r9ct"
server_key: "4ecbf5cc99dd91fc9a26143e49f5ddac"
server_key_iv: "c3bb22339569ccfdf29cb2695fa5d57b"
server_key_version: "encryptionkey@0"
I20260618 23:19:51.550848 8241 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:19:51.551738 8255 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:51.552086 8241 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:51.552202 8241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "e8a6468b9a3d4bdf9b102fdfc329b11f"
format_stamp: "Formatted at 2026-06-18 23:19:51 on dist-test-slave-r9ct"
server_key: "4ecbf5cc99dd91fc9a26143e49f5ddac"
server_key_iv: "c3bb22339569ccfdf29cb2695fa5d57b"
server_key_version: "encryptionkey@0"
I20260618 23:19:51.552294 8241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:51.565606 8241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:51.568678 8241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:51.568871 8241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:51.569130 8241 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:51.569451 8241 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:51.569506 8241 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:51.569548 8241 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:51.569576 8241 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:51.576614 8241 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:35715
I20260618 23:19:51.576647 8368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:35715 every 8 connection(s)
I20260618 23:19:51.576972 8241 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
Jun 18 23:19:51 dist-test-slave-r9ct krb5kdc[8002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824791, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:51.585606 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 8241
I20260618 23:19:51.585732 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:19:51.585922 3942 external_mini_cluster.cc:1428] Setting key 64e1dfe6b3f7bbd6b00c3e1463dff786
I20260618 23:19:51.587117 8086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:51.577789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:52317 (local address 127.3.217.190:46793)
0618 23:19:51.577878 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:51.577881 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:51.578117 (+ 236us) server_negotiation.cc:407] Connection header received
0618 23:19:51.578865 (+ 748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:51.578867 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:51.578880 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:51.578931 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:51.579835 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.580335 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.581316 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.581519 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.581603 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:51.583966 (+ 2363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:51.583967 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:51.583968 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:51.583974 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:51.585438 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:51.585955 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:51.585956 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:51.585957 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:51.586033 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:51.586349 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:51.586350 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:51.586350 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:51.586483 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:51.586553 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:51.586941 (+ 388us) server_negotiation.cc:299] Negotiation successful
0618 23:19:51.587022 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260618 23:19:51.587270 8371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:51.577659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:46793 (local address 127.3.217.130:52317)
0618 23:19:51.577927 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:51.577996 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:51.578682 (+ 686us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:51.578998 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:51.579002 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:51.579279 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:51.579736 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:51.579740 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.580431 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.580432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:51.581214 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:51.581216 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.581613 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.581614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:51.581740 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:51.582248 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:51.582256 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:51.583876 (+ 1620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:51.585533 (+ 1657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:51.585540 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:51.585542 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:51.585872 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:51.586124 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:51.586125 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:51.586125 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:51.586256 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:51.586574 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:51.586580 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:51.586763 (+ 183us) client_negotiation.cc:769] Sending connection context
0618 23:19:51.586887 (+ 124us) client_negotiation.cc:240] Negotiation successful
0618 23:19:51.587042 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":104,"threads_started":1}
I20260618 23:19:51.587675 8369 heartbeater.cc:347] Connected to a master server at 127.3.217.190:46793
I20260618 23:19:51.587774 8369 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:51.587918 8369 heartbeater.cc:511] Master 127.3.217.190:46793 requested a full tablet report, sending...
I20260618 23:19:51.588328 8046 ts_manager.cc:194] Registered new tserver with Master: e8a6468b9a3d4bdf9b102fdfc329b11f (127.3.217.130:35715)
I20260618 23:19:51.588858 8046 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:52317
WARNING: no policy specified for kudu/127.3.217.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
I20260618 23:19:51.612143 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:46793
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:42655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:51.695041 8374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:51.695236 8374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:51.695259 8374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:51.696709 8374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:51.696769 8374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:51.696818 8374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:19:51.698522 8374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:42655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:46793
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:51.698829 8374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:51.699074 8374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:51.704133 8380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:51.704133 8382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:51.704252 8379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:51.704617 8374 server_base.cc:1034] running on GCE node
I20260618 23:19:51.704969 8374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:51.705387 8374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:51.706538 8374 hybrid_clock.cc:648] HybridClock initialized: now 1781824791706492 us; error 62 us; skew 500 ppm
Jun 18 23:19:51 dist-test-slave-r9ct krb5kdc[8002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824791, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:51.709396 8374 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:19:51.709748 8374 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:51.709794 8374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:51.709942 8374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:51.710985 8374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "4b03a0cd630a40d98b7a48b5b1fcaf0b"
format_stamp: "Formatted at 2026-06-18 23:19:51 on dist-test-slave-r9ct"
server_key: "6dadda6bc2abec558f3f656445fd7cfa"
server_key_iv: "c572bb1177d6b616b662602781962190"
server_key_version: "encryptionkey@0"
I20260618 23:19:51.711273 8374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "4b03a0cd630a40d98b7a48b5b1fcaf0b"
format_stamp: "Formatted at 2026-06-18 23:19:51 on dist-test-slave-r9ct"
server_key: "6dadda6bc2abec558f3f656445fd7cfa"
server_key_iv: "c572bb1177d6b616b662602781962190"
server_key_version: "encryptionkey@0"
I20260618 23:19:51.712462 8374 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:51.713179 8388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:51.713363 8374 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260618 23:19:51.713431 8374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "4b03a0cd630a40d98b7a48b5b1fcaf0b"
format_stamp: "Formatted at 2026-06-18 23:19:51 on dist-test-slave-r9ct"
server_key: "6dadda6bc2abec558f3f656445fd7cfa"
server_key_iv: "c572bb1177d6b616b662602781962190"
server_key_version: "encryptionkey@0"
I20260618 23:19:51.713519 8374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:51.728997 8374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:51.732260 8374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:51.732533 8374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:51.732827 8374 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:51.733166 8374 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:51.733224 8374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:51.733265 8374 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:51.733294 8374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:51.739408 8374 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:33399
I20260618 23:19:51.739485 8501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:33399 every 8 connection(s)
I20260618 23:19:51.739745 8374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
Jun 18 23:19:51 dist-test-slave-r9ct krb5kdc[8002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824791, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:51.747061 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 8374
I20260618 23:19:51.747144 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:19:51.747332 3942 external_mini_cluster.cc:1428] Setting key 4787f041e881c67fa5154f4e6fd756d0
I20260618 23:19:51.750427 8086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:51.740644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:46215 (local address 127.3.217.190:46793)
0618 23:19:51.740720 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:51.740723 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:51.740828 (+ 105us) server_negotiation.cc:407] Connection header received
0618 23:19:51.741356 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:51.741357 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:51.741367 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:51.741420 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:51.742278 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.742896 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.743898 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.744091 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.744155 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:51.746429 (+ 2274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:51.746430 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:51.746431 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:51.746437 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:51.748502 (+ 2065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:51.749123 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:51.749124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:51.749125 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:51.749390 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:51.749749 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:51.749751 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:51.749751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:51.749892 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:51.749967 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:51.750242 (+ 275us) server_negotiation.cc:299] Negotiation successful
0618 23:19:51.750323 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260618 23:19:51.750659 8504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:51.740562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:46793 (local address 127.3.217.131:46215)
0618 23:19:51.740712 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:51.740760 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:51.741233 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:51.741471 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:51.741474 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:51.741737 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:51.742199 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:51.742204 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.742991 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.742992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:51.743797 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:51.743799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.744170 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.744171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:51.744266 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:51.744741 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:51.744749 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:51.746325 (+ 1576us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:51.748645 (+ 2320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:51.748657 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:51.748661 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:51.748958 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:51.749521 (+ 563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:51.749522 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:51.749523 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:51.749661 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:51.749971 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:51.749978 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:51.750110 (+ 132us) client_negotiation.cc:769] Sending connection context
0618 23:19:51.750219 (+ 109us) client_negotiation.cc:240] Negotiation successful
0618 23:19:51.750399 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":64,"threads_started":1}
I20260618 23:19:51.751178 8502 heartbeater.cc:347] Connected to a master server at 127.3.217.190:46793
I20260618 23:19:51.751259 8502 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:51.751410 8502 heartbeater.cc:511] Master 127.3.217.190:46793 requested a full tablet report, sending...
I20260618 23:19:51.751844 8046 ts_manager.cc:194] Registered new tserver with Master: 4b03a0cd630a40d98b7a48b5b1fcaf0b (127.3.217.131:33399)
I20260618 23:19:51.752266 8046 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:46215
I20260618 23:19:51.759712 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260618 23:19:51.767590 8086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:51.761230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43936 (local address 127.3.217.190:46793)
0618 23:19:51.761270 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:51.761272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:51.761393 (+ 121us) server_negotiation.cc:407] Connection header received
0618 23:19:51.761415 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:51.761416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:51.761425 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:51.761468 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:51.762002 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.762499 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.763324 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.763522 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.763579 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:51.764863 (+ 1284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:51.764864 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:51.764865 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:51.764872 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:51.766453 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:51.766843 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:51.766844 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:51.766844 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:51.766913 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:51.767130 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:51.767131 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:51.767131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:51.767261 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:51.767335 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:51.767473 (+ 138us) server_negotiation.cc:299] Negotiation successful
0618 23:19:51.767531 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260618 23:19:51.769279 8046 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43936:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:19:51.770789 8046 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:19:51.778546 8515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:51.773901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45948 (local address 127.3.217.131:33399)
0618 23:19:51.774398 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:51.774404 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:51.774417 (+ 13us) server_negotiation.cc:407] Connection header received
0618 23:19:51.774466 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:51.774469 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:51.774596 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:51.774901 (+ 305us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:51.775067 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.776111 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.777369 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.778120 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.778204 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:51.778262 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:51.778425 (+ 163us) server_negotiation.cc:299] Negotiation successful
0618 23:19:51.778466 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":98,"threads_started":1}
I20260618 23:19:51.778560 8514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:51.773667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:33399 (local address 127.0.0.1:45948)
0618 23:19:51.773858 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:51.773896 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:51.773985 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:51.774897 (+ 912us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:51.774898 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:51.774900 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:51.774977 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:51.774978 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.776205 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.776206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:51.777268 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:51.777270 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.778225 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.778226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:51.778313 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:51.778327 (+ 14us) client_negotiation.cc:769] Sending connection context
0618 23:19:51.778405 (+ 78us) client_negotiation.cc:240] Negotiation successful
0618 23:19:51.778483 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":63,"thread_start_us":76,"threads_started":1}
I20260618 23:19:51.778560 8516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:51.773667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:38435 (local address 127.0.0.1:41762)
0618 23:19:51.774091 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:51.774104 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:51.774241 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:51.774631 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:51.774635 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:51.774638 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:51.774705 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:51.774707 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.776060 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.776061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:51.777395 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:51.777397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.778223 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.778224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:51.778315 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:51.778327 (+ 12us) client_negotiation.cc:769] Sending connection context
0618 23:19:51.778405 (+ 78us) client_negotiation.cc:240] Negotiation successful
0618 23:19:51.778471 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"mutex_wait_us":64,"thread_start_us":105,"threads_started":1}
I20260618 23:19:51.779374 8518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:51.774152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41762 (local address 127.3.217.129:38435)
0618 23:19:51.774336 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:51.774340 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:51.774352 (+ 12us) server_negotiation.cc:407] Connection header received
0618 23:19:51.774392 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:51.774394 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:51.774412 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:51.774494 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:51.774799 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.775926 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.777487 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.778147 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.778210 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:51.778262 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:51.779221 (+ 959us) server_negotiation.cc:299] Negotiation successful
0618 23:19:51.779266 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":102,"threads_started":1}
I20260618 23:19:51.779458 8513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:51.773929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:35715 (local address 127.0.0.1:60288)
0618 23:19:51.774328 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:51.774338 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:51.774390 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:51.774895 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:51.774896 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:51.774898 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:51.774959 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:51.774961 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.775818 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.775819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:51.777395 (+ 1576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:51.777397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.779225 (+ 1828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.779226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:51.779282 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:51.779286 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:19:51.779336 (+ 50us) client_negotiation.cc:240] Negotiation successful
0618 23:19:51.779376 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"mutex_wait_us":89,"thread_start_us":88,"threads_started":1}
I20260618 23:19:51.779690 8517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:51.774070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60288 (local address 127.3.217.130:35715)
0618 23:19:51.774237 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:51.774242 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:51.774461 (+ 219us) server_negotiation.cc:407] Connection header received
0618 23:19:51.774510 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:51.774513 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:51.774529 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:51.774616 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:51.775035 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.775710 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.778309 (+ 2599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.779073 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.779141 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:51.779189 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:51.779555 (+ 366us) server_negotiation.cc:299] Negotiation successful
0618 23:19:51.779610 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":110,"threads_started":1}
I20260618 23:19:51.779812 8436 tablet_service.cc:1467] Processing CreateTablet for tablet 70d31e3488824b6fbad7bcd3171ada8d (DEFAULT_TABLE table=test-table [id=1ff22dc7433f4a74a7bbbed7137ddf7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:51.780176 8436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70d31e3488824b6fbad7bcd3171ada8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:51.780184 8170 tablet_service.cc:1467] Processing CreateTablet for tablet 70d31e3488824b6fbad7bcd3171ada8d (DEFAULT_TABLE table=test-table [id=1ff22dc7433f4a74a7bbbed7137ddf7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:51.780313 8303 tablet_service.cc:1467] Processing CreateTablet for tablet 70d31e3488824b6fbad7bcd3171ada8d (DEFAULT_TABLE table=test-table [id=1ff22dc7433f4a74a7bbbed7137ddf7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:51.780507 8170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70d31e3488824b6fbad7bcd3171ada8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:51.780596 8303 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70d31e3488824b6fbad7bcd3171ada8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:51.782874 8519 tablet_bootstrap.cc:492] T 70d31e3488824b6fbad7bcd3171ada8d P 67f372a7279d45eeb449afcf1ac3b586: Bootstrap starting.
I20260618 23:19:51.783448 8520 tablet_bootstrap.cc:492] T 70d31e3488824b6fbad7bcd3171ada8d P 4b03a0cd630a40d98b7a48b5b1fcaf0b: Bootstrap starting.
I20260618 23:19:51.783532 8519 tablet_bootstrap.cc:654] T 70d31e3488824b6fbad7bcd3171ada8d P 67f372a7279d45eeb449afcf1ac3b586: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:51.784017 8521 tablet_bootstrap.cc:492] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f: Bootstrap starting.
I20260618 23:19:51.784374 8519 log.cc:824] T 70d31e3488824b6fbad7bcd3171ada8d P 67f372a7279d45eeb449afcf1ac3b586: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:51.784425 8520 tablet_bootstrap.cc:654] T 70d31e3488824b6fbad7bcd3171ada8d P 4b03a0cd630a40d98b7a48b5b1fcaf0b: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:51.784574 8521 tablet_bootstrap.cc:654] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:51.784969 8520 log.cc:824] T 70d31e3488824b6fbad7bcd3171ada8d P 4b03a0cd630a40d98b7a48b5b1fcaf0b: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:51.785194 8521 log.cc:824] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:51.785248 8519 tablet_bootstrap.cc:492] T 70d31e3488824b6fbad7bcd3171ada8d P 67f372a7279d45eeb449afcf1ac3b586: No bootstrap required, opened a new log
I20260618 23:19:51.785344 8519 ts_tablet_manager.cc:1397] T 70d31e3488824b6fbad7bcd3171ada8d P 67f372a7279d45eeb449afcf1ac3b586: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260618 23:19:51.785831 8520 tablet_bootstrap.cc:492] T 70d31e3488824b6fbad7bcd3171ada8d P 4b03a0cd630a40d98b7a48b5b1fcaf0b: No bootstrap required, opened a new log
I20260618 23:19:51.785888 8521 tablet_bootstrap.cc:492] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f: No bootstrap required, opened a new log
I20260618 23:19:51.785959 8521 ts_tablet_manager.cc:1397] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:19:51.786028 8520 ts_tablet_manager.cc:1397] T 70d31e3488824b6fbad7bcd3171ada8d P 4b03a0cd630a40d98b7a48b5b1fcaf0b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260618 23:19:51.787612 8519 raft_consensus.cc:348] T 70d31e3488824b6fbad7bcd3171ada8d P 67f372a7279d45eeb449afcf1ac3b586 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b03a0cd630a40d98b7a48b5b1fcaf0b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33399 } } peers { permanent_uuid: "67f372a7279d45eeb449afcf1ac3b586" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 38435 } } peers { permanent_uuid: "e8a6468b9a3d4bdf9b102fdfc329b11f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 35715 } }
I20260618 23:19:51.787799 8519 raft_consensus.cc:374] T 70d31e3488824b6fbad7bcd3171ada8d P 67f372a7279d45eeb449afcf1ac3b586 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:51.787843 8519 raft_consensus.cc:729] T 70d31e3488824b6fbad7bcd3171ada8d P 67f372a7279d45eeb449afcf1ac3b586 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67f372a7279d45eeb449afcf1ac3b586, State: Initialized, Role: FOLLOWER
I20260618 23:19:51.787925 8521 raft_consensus.cc:348] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b03a0cd630a40d98b7a48b5b1fcaf0b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33399 } } peers { permanent_uuid: "67f372a7279d45eeb449afcf1ac3b586" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 38435 } } peers { permanent_uuid: "e8a6468b9a3d4bdf9b102fdfc329b11f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 35715 } }
I20260618 23:19:51.787984 8519 consensus_queue.cc:260] T 70d31e3488824b6fbad7bcd3171ada8d P 67f372a7279d45eeb449afcf1ac3b586 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b03a0cd630a40d98b7a48b5b1fcaf0b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33399 } } peers { permanent_uuid: "67f372a7279d45eeb449afcf1ac3b586" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 38435 } } peers { permanent_uuid: "e8a6468b9a3d4bdf9b102fdfc329b11f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 35715 } }
I20260618 23:19:51.788079 8521 raft_consensus.cc:374] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:51.788117 8521 raft_consensus.cc:729] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8a6468b9a3d4bdf9b102fdfc329b11f, State: Initialized, Role: FOLLOWER
I20260618 23:19:51.788261 8519 ts_tablet_manager.cc:1428] T 70d31e3488824b6fbad7bcd3171ada8d P 67f372a7279d45eeb449afcf1ac3b586: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260618 23:19:51.788237 8521 consensus_queue.cc:260] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b03a0cd630a40d98b7a48b5b1fcaf0b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33399 } } peers { permanent_uuid: "67f372a7279d45eeb449afcf1ac3b586" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 38435 } } peers { permanent_uuid: "e8a6468b9a3d4bdf9b102fdfc329b11f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 35715 } }
I20260618 23:19:51.788281 8520 raft_consensus.cc:348] T 70d31e3488824b6fbad7bcd3171ada8d P 4b03a0cd630a40d98b7a48b5b1fcaf0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b03a0cd630a40d98b7a48b5b1fcaf0b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33399 } } peers { permanent_uuid: "67f372a7279d45eeb449afcf1ac3b586" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 38435 } } peers { permanent_uuid: "e8a6468b9a3d4bdf9b102fdfc329b11f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 35715 } }
I20260618 23:19:51.788514 8369 heartbeater.cc:503] Master 127.3.217.190:46793 was elected leader, sending a full tablet report...
I20260618 23:19:51.788553 8520 raft_consensus.cc:374] T 70d31e3488824b6fbad7bcd3171ada8d P 4b03a0cd630a40d98b7a48b5b1fcaf0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:51.788606 8520 raft_consensus.cc:729] T 70d31e3488824b6fbad7bcd3171ada8d P 4b03a0cd630a40d98b7a48b5b1fcaf0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b03a0cd630a40d98b7a48b5b1fcaf0b, State: Initialized, Role: FOLLOWER
I20260618 23:19:51.788508 8521 ts_tablet_manager.cc:1428] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260618 23:19:51.788717 8520 consensus_queue.cc:260] T 70d31e3488824b6fbad7bcd3171ada8d P 4b03a0cd630a40d98b7a48b5b1fcaf0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b03a0cd630a40d98b7a48b5b1fcaf0b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33399 } } peers { permanent_uuid: "67f372a7279d45eeb449afcf1ac3b586" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 38435 } } peers { permanent_uuid: "e8a6468b9a3d4bdf9b102fdfc329b11f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 35715 } }
I20260618 23:19:51.788996 8520 ts_tablet_manager.cc:1428] T 70d31e3488824b6fbad7bcd3171ada8d P 4b03a0cd630a40d98b7a48b5b1fcaf0b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260618 23:19:51.789011 8502 heartbeater.cc:503] Master 127.3.217.190:46793 was elected leader, sending a full tablet report...
I20260618 23:19:51.789395 8236 heartbeater.cc:503] Master 127.3.217.190:46793 was elected leader, sending a full tablet report...
W20260618 23:19:51.827491 8370 tablet.cc:2369] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 23:19:51.832532 8526 raft_consensus.cc:482] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:19:51.832639 8526 raft_consensus.cc:504] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b03a0cd630a40d98b7a48b5b1fcaf0b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33399 } } peers { permanent_uuid: "67f372a7279d45eeb449afcf1ac3b586" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 38435 } } peers { permanent_uuid: "e8a6468b9a3d4bdf9b102fdfc329b11f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 35715 } }
I20260618 23:19:51.833106 8526 leader_election.cc:288] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b03a0cd630a40d98b7a48b5b1fcaf0b (127.3.217.131:33399), 67f372a7279d45eeb449afcf1ac3b586 (127.3.217.129:38435)
I20260618 23:19:51.836321 8371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:51.833295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:38435 (local address 127.3.217.130:47729)
0618 23:19:51.833428 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:51.833444 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:51.833507 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:51.833801 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:51.833802 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:51.833804 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:51.833863 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:51.833865 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.834493 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.834494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:51.835310 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:51.835312 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.836085 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.836086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:51.836151 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:51.836154 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:19:51.836212 (+ 58us) client_negotiation.cc:240] Negotiation successful
0618 23:19:51.836249 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260618 23:19:51.836321 8518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:51.833416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:47729 (local address 127.3.217.129:38435)
0618 23:19:51.833474 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:51.833476 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:51.833492 (+ 16us) server_negotiation.cc:407] Connection header received
0618 23:19:51.833684 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:51.833686 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:51.833705 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:51.833788 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:51.833947 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.834409 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.835409 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.835990 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.836074 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:51.836083 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:51.836229 (+ 146us) server_negotiation.cc:299] Negotiation successful
0618 23:19:51.836261 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260618 23:19:51.836512 8528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:51.833509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:33399 (local address 127.3.217.130:36883)
0618 23:19:51.833796 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:51.833810 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:51.833922 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:51.834089 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:51.834090 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:51.834091 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:19:51.834164 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:51.834165 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.834803 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.834804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:51.835527 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:51.835529 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.836204 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.836205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:51.836284 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:51.836287 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:19:51.836366 (+ 79us) client_negotiation.cc:240] Negotiation successful
0618 23:19:51.836409 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":213,"threads_started":1}
I20260618 23:19:51.836612 8515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:51.833552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:36883 (local address 127.3.217.131:33399)
0618 23:19:51.833595 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:51.833596 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:51.833904 (+ 308us) server_negotiation.cc:407] Connection header received
0618 23:19:51.834006 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:51.834007 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:51.834017 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:51.834085 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:19:51.834233 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.834696 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.835616 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.836124 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.836205 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:51.836213 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:51.836503 (+ 290us) server_negotiation.cc:299] Negotiation successful
0618 23:19:51.836545 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260618 23:19:51.836788 8190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70d31e3488824b6fbad7bcd3171ada8d" candidate_uuid: "e8a6468b9a3d4bdf9b102fdfc329b11f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f372a7279d45eeb449afcf1ac3b586" is_pre_election: true
I20260618 23:19:51.836891 8456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70d31e3488824b6fbad7bcd3171ada8d" candidate_uuid: "e8a6468b9a3d4bdf9b102fdfc329b11f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b03a0cd630a40d98b7a48b5b1fcaf0b" is_pre_election: true
I20260618 23:19:51.836936 8190 raft_consensus.cc:2454] T 70d31e3488824b6fbad7bcd3171ada8d P 67f372a7279d45eeb449afcf1ac3b586 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a6468b9a3d4bdf9b102fdfc329b11f in term 0.
I20260618 23:19:51.837013 8456 raft_consensus.cc:2454] T 70d31e3488824b6fbad7bcd3171ada8d P 4b03a0cd630a40d98b7a48b5b1fcaf0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a6468b9a3d4bdf9b102fdfc329b11f in term 0.
I20260618 23:19:51.837142 8257 leader_election.cc:302] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67f372a7279d45eeb449afcf1ac3b586, e8a6468b9a3d4bdf9b102fdfc329b11f; no voters:
I20260618 23:19:51.837261 8526 raft_consensus.cc:2781] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:19:51.837390 8526 raft_consensus.cc:482] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:19:51.837496 8526 raft_consensus.cc:3037] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:51.838469 8526 raft_consensus.cc:504] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b03a0cd630a40d98b7a48b5b1fcaf0b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33399 } } peers { permanent_uuid: "67f372a7279d45eeb449afcf1ac3b586" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 38435 } } peers { permanent_uuid: "e8a6468b9a3d4bdf9b102fdfc329b11f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 35715 } }
I20260618 23:19:51.838635 8526 leader_election.cc:288] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f [CANDIDATE]: Term 1 election: Requested vote from peers 4b03a0cd630a40d98b7a48b5b1fcaf0b (127.3.217.131:33399), 67f372a7279d45eeb449afcf1ac3b586 (127.3.217.129:38435)
I20260618 23:19:51.838835 8190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70d31e3488824b6fbad7bcd3171ada8d" candidate_uuid: "e8a6468b9a3d4bdf9b102fdfc329b11f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f372a7279d45eeb449afcf1ac3b586"
I20260618 23:19:51.838856 8456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70d31e3488824b6fbad7bcd3171ada8d" candidate_uuid: "e8a6468b9a3d4bdf9b102fdfc329b11f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b03a0cd630a40d98b7a48b5b1fcaf0b"
I20260618 23:19:51.838925 8456 raft_consensus.cc:3037] T 70d31e3488824b6fbad7bcd3171ada8d P 4b03a0cd630a40d98b7a48b5b1fcaf0b [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:51.838925 8190 raft_consensus.cc:3037] T 70d31e3488824b6fbad7bcd3171ada8d P 67f372a7279d45eeb449afcf1ac3b586 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:51.839784 8190 raft_consensus.cc:2454] T 70d31e3488824b6fbad7bcd3171ada8d P 67f372a7279d45eeb449afcf1ac3b586 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a6468b9a3d4bdf9b102fdfc329b11f in term 1.
I20260618 23:19:51.839792 8456 raft_consensus.cc:2454] T 70d31e3488824b6fbad7bcd3171ada8d P 4b03a0cd630a40d98b7a48b5b1fcaf0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a6468b9a3d4bdf9b102fdfc329b11f in term 1.
I20260618 23:19:51.839993 8256 leader_election.cc:302] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b03a0cd630a40d98b7a48b5b1fcaf0b, e8a6468b9a3d4bdf9b102fdfc329b11f; no voters:
I20260618 23:19:51.840101 8526 raft_consensus.cc:2781] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:51.840261 8526 raft_consensus.cc:686] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f [term 1 LEADER]: Becoming Leader. State: Replica: e8a6468b9a3d4bdf9b102fdfc329b11f, State: Running, Role: LEADER
I20260618 23:19:51.840466 8526 consensus_queue.cc:237] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b03a0cd630a40d98b7a48b5b1fcaf0b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33399 } } peers { permanent_uuid: "67f372a7279d45eeb449afcf1ac3b586" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 38435 } } peers { permanent_uuid: "e8a6468b9a3d4bdf9b102fdfc329b11f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 35715 } }
I20260618 23:19:51.841324 8046 catalog_manager.cc:5495] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f reported cstate change: term changed from 0 to 1, leader changed from <none> to e8a6468b9a3d4bdf9b102fdfc329b11f (127.3.217.130). New cstate: current_term: 1 leader_uuid: "e8a6468b9a3d4bdf9b102fdfc329b11f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b03a0cd630a40d98b7a48b5b1fcaf0b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67f372a7279d45eeb449afcf1ac3b586" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 38435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8a6468b9a3d4bdf9b102fdfc329b11f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 35715 } health_report { overall_health: HEALTHY } } }
I20260618 23:19:51.855624 8517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:51.852775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60304 (local address 127.3.217.130:35715)
0618 23:19:51.852832 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:51.852834 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:51.852842 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:19:51.852886 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:51.852887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:51.852901 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:51.852977 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:19:51.853127 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.853999 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.854808 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:51.855048 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:51.855124 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:51.855285 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:19:51.855395 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:19:51.855488 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:51.855507 (+ 19us) server_negotiation.cc:299] Negotiation successful
0618 23:19:51.855525 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260618 23:19:51.857308 8456 raft_consensus.cc:1261] T 70d31e3488824b6fbad7bcd3171ada8d P 4b03a0cd630a40d98b7a48b5b1fcaf0b [term 1 FOLLOWER]: Refusing update from remote peer e8a6468b9a3d4bdf9b102fdfc329b11f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:19:51.857311 8190 raft_consensus.cc:1261] T 70d31e3488824b6fbad7bcd3171ada8d P 67f372a7279d45eeb449afcf1ac3b586 [term 1 FOLLOWER]: Refusing update from remote peer e8a6468b9a3d4bdf9b102fdfc329b11f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:19:51.857683 8529 consensus_queue.cc:1035] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f [LEADER]: Connected to new peer: Peer: permanent_uuid: "67f372a7279d45eeb449afcf1ac3b586" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 38435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:19:51.857818 8526 consensus_queue.cc:1035] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b03a0cd630a40d98b7a48b5b1fcaf0b" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 33399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:19:51.860064 8532 mvcc.cc:205] Tried to move back new op lower bound from 7298354347444998144 to 7298354347379167232. Current Snapshot: MvccSnapshot[applied={T|T < 7298354347444998144}]
I20260618 23:19:51.860948 8533 mvcc.cc:205] Tried to move back new op lower bound from 7298354347444998144 to 7298354347379167232. Current Snapshot: MvccSnapshot[applied={T|T < 7298354347444998144}]
I20260618 23:19:51.862493 8046 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43936:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:19:51.862597 8046 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43936:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:19:51.863412 8046 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c5a4a6f0a7fb4b0d8e9f33199ab90843: Sending DeleteTablet for 3 replicas of tablet 70d31e3488824b6fbad7bcd3171ada8d
I20260618 23:19:51.863734 8170 tablet_service.cc:1514] Processing DeleteTablet for tablet 70d31e3488824b6fbad7bcd3171ada8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:51 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:41762
I20260618 23:19:51.863758 8436 tablet_service.cc:1514] Processing DeleteTablet for tablet 70d31e3488824b6fbad7bcd3171ada8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:51 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:45948
I20260618 23:19:51.863978 8543 tablet_replica.cc:330] T 70d31e3488824b6fbad7bcd3171ada8d P 67f372a7279d45eeb449afcf1ac3b586: stopping tablet replica
I20260618 23:19:51.864074 8543 raft_consensus.cc:2229] T 70d31e3488824b6fbad7bcd3171ada8d P 67f372a7279d45eeb449afcf1ac3b586 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:19:51.864082 8303 tablet_service.cc:1514] Processing DeleteTablet for tablet 70d31e3488824b6fbad7bcd3171ada8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:51 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:60288
I20260618 23:19:51.864172 8543 raft_consensus.cc:2258] T 70d31e3488824b6fbad7bcd3171ada8d P 67f372a7279d45eeb449afcf1ac3b586 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:51.864290 8544 tablet_replica.cc:330] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f: stopping tablet replica
I20260618 23:19:51.864411 8544 raft_consensus.cc:2229] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:19:51.864427 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 8108
I20260618 23:19:51.864583 8544 raft_consensus.cc:2258] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:51.864650 8543 ts_tablet_manager.cc:1905] T 70d31e3488824b6fbad7bcd3171ada8d P 67f372a7279d45eeb449afcf1ac3b586: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:19:51.866166 8544 ts_tablet_manager.cc:1905] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:19:51.869012 8544 ts_tablet_manager.cc:1918] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:19:51.869132 8544 log.cc:1196] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/70d31e3488824b6fbad7bcd3171ada8d
I20260618 23:19:51.869431 8544 ts_tablet_manager.cc:1939] T 70d31e3488824b6fbad7bcd3171ada8d P e8a6468b9a3d4bdf9b102fdfc329b11f: Deleting consensus metadata
I20260618 23:19:51.869848 8030 catalog_manager.cc:4841] TS e8a6468b9a3d4bdf9b102fdfc329b11f (127.3.217.130:35715): tablet 70d31e3488824b6fbad7bcd3171ada8d (table test-table [id=1ff22dc7433f4a74a7bbbed7137ddf7c]) successfully deleted
I20260618 23:19:51.870859 8542 tablet_replica.cc:330] T 70d31e3488824b6fbad7bcd3171ada8d P 4b03a0cd630a40d98b7a48b5b1fcaf0b: stopping tablet replica
I20260618 23:19:51.871335 8542 raft_consensus.cc:2229] T 70d31e3488824b6fbad7bcd3171ada8d P 4b03a0cd630a40d98b7a48b5b1fcaf0b [term 1 FOLLOWER]: Raft consensus shutting down.
W20260618 23:19:51.871471 8031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.217.129:38435 (error 108)
I20260618 23:19:51.871505 8542 raft_consensus.cc:2258] T 70d31e3488824b6fbad7bcd3171ada8d P 4b03a0cd630a40d98b7a48b5b1fcaf0b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:51.871965 8513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:51.871854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:38435 (local address 127.0.0.1:41770)
0618 23:19:51.871894 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:51.871934 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.129:38435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260618 23:19:51.871958 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 8241
W20260618 23:19:51.874799 8031 catalog_manager.cc:4584] TS 67f372a7279d45eeb449afcf1ac3b586 (127.3.217.129:38435): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 70d31e3488824b6fbad7bcd3171ada8d: Network error: Client connection negotiation failed: client connection to 127.3.217.129:38435: connect: Connection refused (error 111)
I20260618 23:19:51.877242 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 8374
I20260618 23:19:51.877506 8542 ts_tablet_manager.cc:1905] T 70d31e3488824b6fbad7bcd3171ada8d P 4b03a0cd630a40d98b7a48b5b1fcaf0b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:19:51.881804 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 8015
I20260618 23:19:51.881844 8513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:51.881710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:33399 (local address 127.0.0.1:45950)
0618 23:19:51.881777 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:51.881810 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.131:33399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
2026-06-18T23:19:51Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2019 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-06-18T23:19:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:19:51Z Disabled control of system clock
I20260618 23:19:51.909171 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:36819
--webserver_interface=127.3.217.190
--webserver_port=0
--builtin_ntp_servers=127.3.217.148:38929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:36819
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260618 23:19:51.989060 8549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:51.989264 8549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:51.989285 8549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:51.990326 8549 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:19:51.990361 8549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:51.990373 8549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:51.990386 8549 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:19:51.990398 8549 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:19:51.991699 8549 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:38929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:36819
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:36819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8549
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:51.991880 8549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:51.992106 8549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:51.997073 8555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:51.997059 8557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:51.997188 8554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:51.997749 8549 server_base.cc:1034] running on GCE node
I20260618 23:19:51.998068 8549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:51.998347 8549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:51.999512 8549 hybrid_clock.cc:648] HybridClock initialized: now 1781824791999493 us; error 38 us; skew 500 ppm
I20260618 23:19:52.000865 8549 webserver.cc:460] Webserver started at http://127.3.217.190:43555/ using document root <none> and password file <none>
I20260618 23:19:52.001152 8549 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:52.001226 8549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:52.001384 8549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:52.002449 8549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "aa593c580daa48ee8ecddf5115e23e10"
format_stamp: "Formatted at 2026-06-18 23:19:51 on dist-test-slave-r9ct"
server_key: "04eada2e00719be5348c32044156df6e"
server_key_iv: "160ed95b35e7997a8e90015c90ab00c2"
server_key_version: "encryptionkey@0"
I20260618 23:19:52.002866 8549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "aa593c580daa48ee8ecddf5115e23e10"
format_stamp: "Formatted at 2026-06-18 23:19:51 on dist-test-slave-r9ct"
server_key: "04eada2e00719be5348c32044156df6e"
server_key_iv: "160ed95b35e7997a8e90015c90ab00c2"
server_key_version: "encryptionkey@0"
I20260618 23:19:52.004217 8549 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:19:52.005134 8563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:52.005594 8549 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:19:52.005790 8549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "aa593c580daa48ee8ecddf5115e23e10"
format_stamp: "Formatted at 2026-06-18 23:19:51 on dist-test-slave-r9ct"
server_key: "04eada2e00719be5348c32044156df6e"
server_key_iv: "160ed95b35e7997a8e90015c90ab00c2"
server_key_version: "encryptionkey@0"
I20260618 23:19:52.005918 8549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:52.009287 8549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:52.009572 8549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:52.009716 8549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:52.013897 8549 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:36819
I20260618 23:19:52.013955 8615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:36819 every 8 connection(s)
I20260618 23:19:52.014346 8549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:19:52.015029 8616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:52.017591 8616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10: Bootstrap starting.
I20260618 23:19:52.018093 8616 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:52.018321 8616 log.cc:824] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:52.019376 8616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10: No bootstrap required, opened a new log
I20260618 23:19:52.021543 8616 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa593c580daa48ee8ecddf5115e23e10" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 36819 } }
I20260618 23:19:52.021693 8616 raft_consensus.cc:374] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:52.021716 8616 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa593c580daa48ee8ecddf5115e23e10, State: Initialized, Role: FOLLOWER
I20260618 23:19:52.021839 8616 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa593c580daa48ee8ecddf5115e23e10" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 36819 } }
I20260618 23:19:52.021894 8616 raft_consensus.cc:388] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:19:52.021915 8616 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:19:52.021991 8616 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:52.022632 8616 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa593c580daa48ee8ecddf5115e23e10" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 36819 } }
I20260618 23:19:52.022783 8616 leader_election.cc:302] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa593c580daa48ee8ecddf5115e23e10; no voters:
I20260618 23:19:52.022992 8616 leader_election.cc:288] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:19:52.023082 8619 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:52.023248 8619 raft_consensus.cc:686] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10 [term 1 LEADER]: Becoming Leader. State: Replica: aa593c580daa48ee8ecddf5115e23e10, State: Running, Role: LEADER
I20260618 23:19:52.023274 8616 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:19:52.023381 8619 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa593c580daa48ee8ecddf5115e23e10" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 36819 } }
I20260618 23:19:52.023667 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 8549
I20260618 23:19:52.023783 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:19:52.023990 3942 external_mini_cluster.cc:1428] Setting key 2ec0f0042a5bb1cf1ea6182e6b7cf544
I20260618 23:19:52.024123 8621 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa593c580daa48ee8ecddf5115e23e10. Latest consensus state: current_term: 1 leader_uuid: "aa593c580daa48ee8ecddf5115e23e10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa593c580daa48ee8ecddf5115e23e10" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 36819 } } }
I20260618 23:19:52.024204 8621 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10 [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:52.024103 8620 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa593c580daa48ee8ecddf5115e23e10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa593c580daa48ee8ecddf5115e23e10" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 36819 } } }
I20260618 23:19:52.024362 8620 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10 [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:52.024945 8628 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:19:52.025619 8628 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:19:52.026366 8633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.024651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50604 (local address 127.3.217.190:36819)
0618 23:19:52.024849 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:52.024859 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:52.024894 (+ 35us) server_negotiation.cc:407] Connection header received
0618 23:19:52.025016 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:52.025024 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:52.025072 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:52.025214 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:52.025922 (+ 708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:52.025925 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:52.025926 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:19:52.025930 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:52.025971 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:19:52.025984 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:52.026023 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:52.026144 (+ 121us) server_negotiation.cc:299] Negotiation successful
0618 23:19:52.026195 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":65,"threads_started":1}
I20260618 23:19:52.027319 8628 catalog_manager.cc:1347] Generated new cluster ID: 96d048a9b66f4aa98f1e9aa15606f8ec
I20260618 23:19:52.027413 8628 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:19:52.049005 8628 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:19:52.049196 8628 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:19:52.052350 8628 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10: Generated new TSK 0
I20260618 23:19:52.052541 8628 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:19:52.057503 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:36819
--builtin_ntp_servers=127.3.217.148:38929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260618 23:19:52.145062 8640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:52.145313 8640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:52.145358 8640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:52.146588 8640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:52.146653 8640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:52.146697 8640 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:19:52.148075 8640 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:38929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:36819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8640
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:52.148340 8640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:52.148635 8640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:52.154458 8646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:52.154485 8645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:52.154460 8648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:52.154736 8640 server_base.cc:1034] running on GCE node
I20260618 23:19:52.155040 8640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:52.155287 8640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:52.156453 8640 hybrid_clock.cc:648] HybridClock initialized: now 1781824792156442 us; error 30 us; skew 500 ppm
I20260618 23:19:52.157740 8640 webserver.cc:460] Webserver started at http://127.3.217.129:37741/ using document root <none> and password file <none>
I20260618 23:19:52.158032 8640 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:52.158110 8640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:52.158274 8640 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:52.159595 8640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "ab3dbcf249d343018ee0fe22ea00eca9"
format_stamp: "Formatted at 2026-06-18 23:19:52 on dist-test-slave-r9ct"
server_key: "90341f79ce378b3713199a8c4e6d0f5f"
server_key_iv: "92d9971a3b976a3eb41b2e6d9ca212bf"
server_key_version: "encryptionkey@0"
I20260618 23:19:52.159946 8640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "ab3dbcf249d343018ee0fe22ea00eca9"
format_stamp: "Formatted at 2026-06-18 23:19:52 on dist-test-slave-r9ct"
server_key: "90341f79ce378b3713199a8c4e6d0f5f"
server_key_iv: "92d9971a3b976a3eb41b2e6d9ca212bf"
server_key_version: "encryptionkey@0"
I20260618 23:19:52.161229 8640 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260618 23:19:52.162017 8654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:52.162201 8640 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:19:52.162292 8640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "ab3dbcf249d343018ee0fe22ea00eca9"
format_stamp: "Formatted at 2026-06-18 23:19:52 on dist-test-slave-r9ct"
server_key: "90341f79ce378b3713199a8c4e6d0f5f"
server_key_iv: "92d9971a3b976a3eb41b2e6d9ca212bf"
server_key_version: "encryptionkey@0"
I20260618 23:19:52.162346 8640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:52.165560 8640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:52.165791 8640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:52.165889 8640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:52.166060 8640 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:52.166332 8640 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:52.166361 8640 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:52.166383 8640 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:52.166395 8640 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:52.172482 8640 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:45091
I20260618 23:19:52.172549 8767 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:45091 every 8 connection(s)
I20260618 23:19:52.172830 8640 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:19:52.176149 8633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.173819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:60179 (local address 127.3.217.190:36819)
0618 23:19:52.173914 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:52.173916 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:52.174098 (+ 182us) server_negotiation.cc:407] Connection header received
0618 23:19:52.174593 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:52.174594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:52.174602 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:52.174658 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:52.175880 (+ 1222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:52.175881 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:52.175881 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:19:52.175886 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:52.175899 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:19:52.175904 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:52.175963 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:52.176064 (+ 101us) server_negotiation.cc:299] Negotiation successful
0618 23:19:52.176081 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260618 23:19:52.176362 8770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.173712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:36819 (local address 127.3.217.129:60179)
0618 23:19:52.173970 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:52.174015 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:52.174489 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:52.174745 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:52.174749 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:52.174758 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:52.175727 (+ 969us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:19:52.175728 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:52.175754 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:19:52.175781 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:52.175962 (+ 181us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:52.175967 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:52.175970 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:19:52.176071 (+ 101us) client_negotiation.cc:240] Negotiation successful
0618 23:19:52.176129 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":130,"threads_started":1}
I20260618 23:19:52.176873 8768 heartbeater.cc:347] Connected to a master server at 127.3.217.190:36819
I20260618 23:19:52.176947 8768 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:52.177109 8768 heartbeater.cc:511] Master 127.3.217.190:36819 requested a full tablet report, sending...
I20260618 23:19:52.177713 8580 ts_manager.cc:194] Registered new tserver with Master: ab3dbcf249d343018ee0fe22ea00eca9 (127.3.217.129:45091)
I20260618 23:19:52.182567 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 8640
I20260618 23:19:52.182651 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:19:52.182884 3942 external_mini_cluster.cc:1428] Setting key ba1e3553e41da11d3933b0a664472575
I20260618 23:19:52.183956 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:36819
--builtin_ntp_servers=127.3.217.148:38929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260618 23:19:52.268031 8771 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:52.268229 8771 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:52.268249 8771 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:52.269304 8771 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:52.269345 8771 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:52.269371 8771 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:19:52.270612 8771 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:38929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:36819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8771
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:52.270802 8771 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:52.271034 8771 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:52.275792 8779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:52.275969 8777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:52.275780 8776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:52.276089 8771 server_base.cc:1034] running on GCE node
I20260618 23:19:52.276301 8771 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:52.276530 8771 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:52.277695 8771 hybrid_clock.cc:648] HybridClock initialized: now 1781824792277688 us; error 35 us; skew 500 ppm
I20260618 23:19:52.279434 8771 webserver.cc:460] Webserver started at http://127.3.217.130:38575/ using document root <none> and password file <none>
I20260618 23:19:52.279755 8771 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:52.279830 8771 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:52.279991 8771 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:52.281296 8771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "fdb519a1510e441da517602402135c99"
format_stamp: "Formatted at 2026-06-18 23:19:52 on dist-test-slave-r9ct"
server_key: "11a3ac768eb72ed103709d37d7cbe5ef"
server_key_iv: "6d629c70bdb1243afd37eabf3c338b49"
server_key_version: "encryptionkey@0"
I20260618 23:19:52.281949 8771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "fdb519a1510e441da517602402135c99"
format_stamp: "Formatted at 2026-06-18 23:19:52 on dist-test-slave-r9ct"
server_key: "11a3ac768eb72ed103709d37d7cbe5ef"
server_key_iv: "6d629c70bdb1243afd37eabf3c338b49"
server_key_version: "encryptionkey@0"
I20260618 23:19:52.283618 8771 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260618 23:19:52.284535 8785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:52.284776 8771 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:52.284946 8771 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "fdb519a1510e441da517602402135c99"
format_stamp: "Formatted at 2026-06-18 23:19:52 on dist-test-slave-r9ct"
server_key: "11a3ac768eb72ed103709d37d7cbe5ef"
server_key_iv: "6d629c70bdb1243afd37eabf3c338b49"
server_key_version: "encryptionkey@0"
I20260618 23:19:52.285039 8771 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:52.288837 8771 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:52.289098 8771 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:52.289243 8771 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:52.289455 8771 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:52.289742 8771 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:52.289794 8771 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:52.289834 8771 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:52.289857 8771 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:52.295908 8771 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:43271
I20260618 23:19:52.295965 8898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:43271 every 8 connection(s)
I20260618 23:19:52.296291 8771 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:19:52.299520 8633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.297067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:48873 (local address 127.3.217.190:36819)
0618 23:19:52.297148 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:52.297151 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:52.297504 (+ 353us) server_negotiation.cc:407] Connection header received
0618 23:19:52.297912 (+ 408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:52.297913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:52.297918 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:52.297980 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:52.299289 (+ 1309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:52.299290 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:52.299290 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:19:52.299294 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:52.299308 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:19:52.299312 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:52.299365 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:52.299460 (+ 95us) server_negotiation.cc:299] Negotiation successful
0618 23:19:52.299471 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260618 23:19:52.299669 8901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.297058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:36819 (local address 127.3.217.130:48873)
0618 23:19:52.297306 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:52.297340 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:52.297795 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:52.298028 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:52.298032 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:52.298039 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:52.299115 (+ 1076us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:19:52.299115 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:52.299141 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:19:52.299167 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:52.299376 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:52.299380 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:52.299382 (+ 2us) client_negotiation.cc:769] Sending connection context
0618 23:19:52.299447 (+ 65us) client_negotiation.cc:240] Negotiation successful
0618 23:19:52.299491 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":133,"threads_started":1}
I20260618 23:19:52.299803 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 8771
I20260618 23:19:52.299922 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:19:52.300083 3942 external_mini_cluster.cc:1428] Setting key 3b89865ca49d04fb295ab71dfde1cfc5
I20260618 23:19:52.300505 8899 heartbeater.cc:347] Connected to a master server at 127.3.217.190:36819
I20260618 23:19:52.300607 8899 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:52.300745 8899 heartbeater.cc:511] Master 127.3.217.190:36819 requested a full tablet report, sending...
I20260618 23:19:52.301167 8579 ts_manager.cc:194] Registered new tserver with Master: fdb519a1510e441da517602402135c99 (127.3.217.130:43271)
I20260618 23:19:52.301515 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:36819
--builtin_ntp_servers=127.3.217.148:38929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260618 23:19:52.385769 8902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:52.386003 8902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:52.386039 8902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:52.387173 8902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:52.387239 8902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:52.387287 8902 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:19:52.388723 8902 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:38929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:36819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8902
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:52.388983 8902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:52.389298 8902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:52.394294 8910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:52.394306 8907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:52.394308 8908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:52.394515 8902 server_base.cc:1034] running on GCE node
I20260618 23:19:52.394685 8902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:52.394948 8902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:52.396122 8902 hybrid_clock.cc:648] HybridClock initialized: now 1781824792396111 us; error 31 us; skew 500 ppm
I20260618 23:19:52.397390 8902 webserver.cc:460] Webserver started at http://127.3.217.131:40271/ using document root <none> and password file <none>
I20260618 23:19:52.397578 8902 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:52.397617 8902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:52.397704 8902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:52.398676 8902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "8b5c8bddf83a427ca6a36ca49b21efc0"
format_stamp: "Formatted at 2026-06-18 23:19:52 on dist-test-slave-r9ct"
server_key: "e7d97536cb793d05f44814390d6ff6bd"
server_key_iv: "d85320203b813d72a7be273dcc3eb276"
server_key_version: "encryptionkey@0"
I20260618 23:19:52.399049 8902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "8b5c8bddf83a427ca6a36ca49b21efc0"
format_stamp: "Formatted at 2026-06-18 23:19:52 on dist-test-slave-r9ct"
server_key: "e7d97536cb793d05f44814390d6ff6bd"
server_key_iv: "d85320203b813d72a7be273dcc3eb276"
server_key_version: "encryptionkey@0"
I20260618 23:19:52.400277 8902 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:52.401234 8916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:52.401484 8902 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:52.401599 8902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "8b5c8bddf83a427ca6a36ca49b21efc0"
format_stamp: "Formatted at 2026-06-18 23:19:52 on dist-test-slave-r9ct"
server_key: "e7d97536cb793d05f44814390d6ff6bd"
server_key_iv: "d85320203b813d72a7be273dcc3eb276"
server_key_version: "encryptionkey@0"
I20260618 23:19:52.401690 8902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:52.405570 8902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:52.405826 8902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:52.405972 8902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:52.406134 8902 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:52.406395 8902 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:52.406445 8902 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:52.406466 8902 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:52.406478 8902 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:52.412282 8902 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:44517
I20260618 23:19:52.412349 9029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:44517 every 8 connection(s)
I20260618 23:19:52.412662 8902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:19:52.415829 8633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.413418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:33935 (local address 127.3.217.190:36819)
0618 23:19:52.413479 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:52.413481 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:52.413818 (+ 337us) server_negotiation.cc:407] Connection header received
0618 23:19:52.414312 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:52.414313 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:52.414319 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:52.414388 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:52.415589 (+ 1201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:52.415590 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:52.415590 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:19:52.415594 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:52.415608 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:19:52.415612 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:52.415656 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:52.415744 (+ 88us) server_negotiation.cc:299] Negotiation successful
0618 23:19:52.415761 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260618 23:19:52.416038 9032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.413383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:36819 (local address 127.3.217.131:33935)
0618 23:19:52.413605 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:52.413635 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:52.414210 (+ 575us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:52.414456 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:52.414459 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:52.414466 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:52.415441 (+ 975us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:19:52.415442 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:52.415469 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:19:52.415495 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:52.415666 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:52.415670 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:52.415672 (+ 2us) client_negotiation.cc:769] Sending connection context
0618 23:19:52.415754 (+ 82us) client_negotiation.cc:240] Negotiation successful
0618 23:19:52.415812 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":85,"threads_started":1}
I20260618 23:19:52.416527 9030 heartbeater.cc:347] Connected to a master server at 127.3.217.190:36819
I20260618 23:19:52.416595 9030 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:52.416771 9030 heartbeater.cc:511] Master 127.3.217.190:36819 requested a full tablet report, sending...
I20260618 23:19:52.416795 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 8902
I20260618 23:19:52.416891 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:19:52.417068 3942 external_mini_cluster.cc:1428] Setting key cdf35f1ce153172fde623e132745dc97
I20260618 23:19:52.417165 8579 ts_manager.cc:194] Registered new tserver with Master: 8b5c8bddf83a427ca6a36ca49b21efc0 (127.3.217.131:44517)
I20260618 23:19:52.417933 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260618 23:19:52.420435 8633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.419211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50612 (local address 127.3.217.190:36819)
0618 23:19:52.419267 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:52.419268 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:52.419412 (+ 144us) server_negotiation.cc:407] Connection header received
0618 23:19:52.419442 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:52.419443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:52.419447 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:52.419504 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:52.420113 (+ 609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:52.420116 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:52.420116 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:19:52.420124 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:52.420159 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:19:52.420165 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:52.420261 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:52.420355 (+ 94us) server_negotiation.cc:299] Negotiation successful
0618 23:19:52.420373 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260618 23:19:52.422134 8579 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50612:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:19:52.423988 8579 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:19:52.427459 9040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.425902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:45091 (local address 127.0.0.1:48846)
0618 23:19:52.426103 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:52.426137 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:52.426191 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:52.426464 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:52.426469 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:52.426475 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:52.427029 (+ 554us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:19:52.427030 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:52.427044 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:19:52.427069 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:52.427286 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:52.427290 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:52.427293 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:19:52.427353 (+ 60us) client_negotiation.cc:240] Negotiation successful
0618 23:19:52.427368 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":83,"threads_started":1}
I20260618 23:19:52.427603 9038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.425902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:44517 (local address 127.0.0.1:41222)
0618 23:19:52.426301 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:52.426311 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:52.426357 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:52.426754 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:52.426755 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:52.426759 (+ 4us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:52.427141 (+ 382us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:19:52.427141 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:52.427149 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:19:52.427162 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:52.427356 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:52.427357 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:52.427358 (+ 1us) client_negotiation.cc:769] Sending connection context
0618 23:19:52.427431 (+ 73us) client_negotiation.cc:240] Negotiation successful
0618 23:19:52.427444 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"mutex_wait_us":2,"thread_start_us":73,"threads_started":1}
I20260618 23:19:52.427634 9041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.425974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41222 (local address 127.3.217.131:44517)
0618 23:19:52.426302 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:52.426307 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:52.426354 (+ 47us) server_negotiation.cc:407] Connection header received
0618 23:19:52.426414 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:52.426417 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:52.426426 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:52.426523 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:52.427232 (+ 709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:52.427238 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:52.427239 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:19:52.427243 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:52.427272 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:19:52.427289 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:52.427347 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:52.427440 (+ 93us) server_negotiation.cc:299] Negotiation successful
0618 23:19:52.427454 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":80,"threads_started":1}
I20260618 23:19:52.427670 9042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.426138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48846 (local address 127.3.217.129:45091)
0618 23:19:52.426305 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:52.426309 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:52.426320 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:19:52.426344 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:52.426346 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:52.426354 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:52.426460 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:52.427147 (+ 687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:52.427153 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:52.427153 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:19:52.427157 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:52.427187 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:19:52.427206 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:52.427259 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:52.427567 (+ 308us) server_negotiation.cc:299] Negotiation successful
0618 23:19:52.427583 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":83,"threads_started":1}
I20260618 23:19:52.428226 8964 tablet_service.cc:1467] Processing CreateTablet for tablet 40bd828ebcd744f2bab1566f863133d7 (DEFAULT_TABLE table=test-table [id=cf2de2ab6532415b9de684f3604cbba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:52.428580 8964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40bd828ebcd744f2bab1566f863133d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:52.428429 8702 tablet_service.cc:1467] Processing CreateTablet for tablet 40bd828ebcd744f2bab1566f863133d7 (DEFAULT_TABLE table=test-table [id=cf2de2ab6532415b9de684f3604cbba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:52.428802 8702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40bd828ebcd744f2bab1566f863133d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:52.429163 9039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.425964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:43271 (local address 127.0.0.1:43350)
0618 23:19:52.426445 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:52.426456 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:52.426488 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:52.427487 (+ 999us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:52.427488 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:52.427491 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:52.428711 (+ 1220us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:19:52.428712 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:52.428720 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:19:52.428732 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:52.429024 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:52.429024 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:52.429025 (+ 1us) client_negotiation.cc:769] Sending connection context
0618 23:19:52.429067 (+ 42us) client_negotiation.cc:240] Negotiation successful
0618 23:19:52.429079 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":94,"threads_started":1}
I20260618 23:19:52.429432 9043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.426166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43350 (local address 127.3.217.130:43271)
0618 23:19:52.426595 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:52.426599 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:52.426608 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:19:52.426632 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:52.427125 (+ 493us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:52.427141 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:52.427223 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:52.428822 (+ 1599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:52.428828 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:52.428828 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:19:52.428833 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:52.428912 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:19:52.428931 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:52.428998 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:52.429339 (+ 341us) server_negotiation.cc:299] Negotiation successful
0618 23:19:52.429358 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":97,"threads_started":1}
I20260618 23:19:52.430277 8833 tablet_service.cc:1467] Processing CreateTablet for tablet 40bd828ebcd744f2bab1566f863133d7 (DEFAULT_TABLE table=test-table [id=cf2de2ab6532415b9de684f3604cbba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:19:52.430581 8833 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40bd828ebcd744f2bab1566f863133d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:52.432009 9045 tablet_bootstrap.cc:492] T 40bd828ebcd744f2bab1566f863133d7 P ab3dbcf249d343018ee0fe22ea00eca9: Bootstrap starting.
I20260618 23:19:52.432381 9044 tablet_bootstrap.cc:492] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0: Bootstrap starting.
I20260618 23:19:52.432523 9045 tablet_bootstrap.cc:654] T 40bd828ebcd744f2bab1566f863133d7 P ab3dbcf249d343018ee0fe22ea00eca9: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:52.432741 9045 log.cc:824] T 40bd828ebcd744f2bab1566f863133d7 P ab3dbcf249d343018ee0fe22ea00eca9: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:52.432983 9044 tablet_bootstrap.cc:654] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:52.433267 9044 log.cc:824] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:52.433358 9045 tablet_bootstrap.cc:492] T 40bd828ebcd744f2bab1566f863133d7 P ab3dbcf249d343018ee0fe22ea00eca9: No bootstrap required, opened a new log
I20260618 23:19:52.433408 9045 ts_tablet_manager.cc:1397] T 40bd828ebcd744f2bab1566f863133d7 P ab3dbcf249d343018ee0fe22ea00eca9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:52.433961 9044 tablet_bootstrap.cc:492] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0: No bootstrap required, opened a new log
I20260618 23:19:52.434031 9044 ts_tablet_manager.cc:1397] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:19:52.434911 9048 tablet_bootstrap.cc:492] T 40bd828ebcd744f2bab1566f863133d7 P fdb519a1510e441da517602402135c99: Bootstrap starting.
I20260618 23:19:52.435524 9048 tablet_bootstrap.cc:654] T 40bd828ebcd744f2bab1566f863133d7 P fdb519a1510e441da517602402135c99: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:52.435837 9048 log.cc:824] T 40bd828ebcd744f2bab1566f863133d7 P fdb519a1510e441da517602402135c99: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:52.436666 9048 tablet_bootstrap.cc:492] T 40bd828ebcd744f2bab1566f863133d7 P fdb519a1510e441da517602402135c99: No bootstrap required, opened a new log
I20260618 23:19:52.436564 9044 raft_consensus.cc:348] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b5c8bddf83a427ca6a36ca49b21efc0" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 44517 } } peers { permanent_uuid: "ab3dbcf249d343018ee0fe22ea00eca9" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45091 } } peers { permanent_uuid: "fdb519a1510e441da517602402135c99" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43271 } }
I20260618 23:19:52.436730 9048 ts_tablet_manager.cc:1397] T 40bd828ebcd744f2bab1566f863133d7 P fdb519a1510e441da517602402135c99: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:19:52.436731 9044 raft_consensus.cc:374] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:52.436642 9045 raft_consensus.cc:348] T 40bd828ebcd744f2bab1566f863133d7 P ab3dbcf249d343018ee0fe22ea00eca9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b5c8bddf83a427ca6a36ca49b21efc0" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 44517 } } peers { permanent_uuid: "ab3dbcf249d343018ee0fe22ea00eca9" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45091 } } peers { permanent_uuid: "fdb519a1510e441da517602402135c99" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43271 } }
I20260618 23:19:52.436765 9044 raft_consensus.cc:729] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b5c8bddf83a427ca6a36ca49b21efc0, State: Initialized, Role: FOLLOWER
I20260618 23:19:52.436805 9045 raft_consensus.cc:374] T 40bd828ebcd744f2bab1566f863133d7 P ab3dbcf249d343018ee0fe22ea00eca9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:52.436838 9045 raft_consensus.cc:729] T 40bd828ebcd744f2bab1566f863133d7 P ab3dbcf249d343018ee0fe22ea00eca9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab3dbcf249d343018ee0fe22ea00eca9, State: Initialized, Role: FOLLOWER
I20260618 23:19:52.436908 9044 consensus_queue.cc:260] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b5c8bddf83a427ca6a36ca49b21efc0" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 44517 } } peers { permanent_uuid: "ab3dbcf249d343018ee0fe22ea00eca9" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45091 } } peers { permanent_uuid: "fdb519a1510e441da517602402135c99" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43271 } }
I20260618 23:19:52.436971 9045 consensus_queue.cc:260] T 40bd828ebcd744f2bab1566f863133d7 P ab3dbcf249d343018ee0fe22ea00eca9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b5c8bddf83a427ca6a36ca49b21efc0" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 44517 } } peers { permanent_uuid: "ab3dbcf249d343018ee0fe22ea00eca9" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45091 } } peers { permanent_uuid: "fdb519a1510e441da517602402135c99" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43271 } }
I20260618 23:19:52.437142 9044 ts_tablet_manager.cc:1428] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260618 23:19:52.437218 9045 ts_tablet_manager.cc:1428] T 40bd828ebcd744f2bab1566f863133d7 P ab3dbcf249d343018ee0fe22ea00eca9: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260618 23:19:52.437268 9030 heartbeater.cc:503] Master 127.3.217.190:36819 was elected leader, sending a full tablet report...
I20260618 23:19:52.437333 8768 heartbeater.cc:503] Master 127.3.217.190:36819 was elected leader, sending a full tablet report...
I20260618 23:19:52.439621 9048 raft_consensus.cc:348] T 40bd828ebcd744f2bab1566f863133d7 P fdb519a1510e441da517602402135c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b5c8bddf83a427ca6a36ca49b21efc0" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 44517 } } peers { permanent_uuid: "ab3dbcf249d343018ee0fe22ea00eca9" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45091 } } peers { permanent_uuid: "fdb519a1510e441da517602402135c99" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43271 } }
I20260618 23:19:52.439759 9048 raft_consensus.cc:374] T 40bd828ebcd744f2bab1566f863133d7 P fdb519a1510e441da517602402135c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:52.439802 9048 raft_consensus.cc:729] T 40bd828ebcd744f2bab1566f863133d7 P fdb519a1510e441da517602402135c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdb519a1510e441da517602402135c99, State: Initialized, Role: FOLLOWER
I20260618 23:19:52.439908 9048 consensus_queue.cc:260] T 40bd828ebcd744f2bab1566f863133d7 P fdb519a1510e441da517602402135c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b5c8bddf83a427ca6a36ca49b21efc0" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 44517 } } peers { permanent_uuid: "ab3dbcf249d343018ee0fe22ea00eca9" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45091 } } peers { permanent_uuid: "fdb519a1510e441da517602402135c99" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43271 } }
I20260618 23:19:52.440161 9048 ts_tablet_manager.cc:1428] T 40bd828ebcd744f2bab1566f863133d7 P fdb519a1510e441da517602402135c99: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260618 23:19:52.440166 8899 heartbeater.cc:503] Master 127.3.217.190:36819 was elected leader, sending a full tablet report...
I20260618 23:19:52.533418 9050 raft_consensus.cc:482] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:19:52.533555 9050 raft_consensus.cc:504] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b5c8bddf83a427ca6a36ca49b21efc0" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 44517 } } peers { permanent_uuid: "ab3dbcf249d343018ee0fe22ea00eca9" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45091 } } peers { permanent_uuid: "fdb519a1510e441da517602402135c99" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43271 } }
I20260618 23:19:52.533874 9050 leader_election.cc:288] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab3dbcf249d343018ee0fe22ea00eca9 (127.3.217.129:45091), fdb519a1510e441da517602402135c99 (127.3.217.130:43271)
I20260618 23:19:52.535364 9042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.534180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:52217 (local address 127.3.217.129:45091)
0618 23:19:52.534232 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:52.534235 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:52.534247 (+ 12us) server_negotiation.cc:407] Connection header received
0618 23:19:52.534279 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:52.534281 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:52.534286 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:52.534395 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:52.535094 (+ 699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:52.535095 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:52.535096 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:19:52.535100 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:52.535116 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:19:52.535121 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:52.535183 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:52.535281 (+ 98us) server_negotiation.cc:299] Negotiation successful
0618 23:19:52.535297 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260618 23:19:52.535364 9032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.534092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:45091 (local address 127.3.217.131:52217)
0618 23:19:52.534138 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:52.534150 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:52.534187 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:52.534406 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:52.534408 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:52.534410 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:52.534980 (+ 570us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:19:52.534980 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:52.534989 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:19:52.535002 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:52.535197 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:52.535197 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:52.535198 (+ 1us) client_negotiation.cc:769] Sending connection context
0618 23:19:52.535276 (+ 78us) client_negotiation.cc:240] Negotiation successful
0618 23:19:52.535293 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260618 23:19:52.535516 9053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.534092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:43271 (local address 127.3.217.131:44803)
0618 23:19:52.534337 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:52.534344 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:52.534581 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:52.534754 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:52.534755 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:52.534757 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:52.535168 (+ 411us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:19:52.535169 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:52.535175 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:19:52.535187 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:52.535314 (+ 127us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:52.535315 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:52.535316 (+ 1us) client_negotiation.cc:769] Sending connection context
0618 23:19:52.535360 (+ 44us) client_negotiation.cc:240] Negotiation successful
0618 23:19:52.535373 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":66,"thread_start_us":114,"threads_started":1}
I20260618 23:19:52.535701 8722 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40bd828ebcd744f2bab1566f863133d7" candidate_uuid: "8b5c8bddf83a427ca6a36ca49b21efc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab3dbcf249d343018ee0fe22ea00eca9" is_pre_election: true
I20260618 23:19:52.535810 8722 raft_consensus.cc:2454] T 40bd828ebcd744f2bab1566f863133d7 P ab3dbcf249d343018ee0fe22ea00eca9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b5c8bddf83a427ca6a36ca49b21efc0 in term 0.
I20260618 23:19:52.535938 9043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.534201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:44803 (local address 127.3.217.130:43271)
0618 23:19:52.534251 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:52.534253 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:52.534404 (+ 151us) server_negotiation.cc:407] Connection header received
0618 23:19:52.534673 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:52.534674 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:52.534679 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:52.534746 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:52.535243 (+ 497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:52.535244 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:52.535245 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:19:52.535249 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:52.535260 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:19:52.535263 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:52.535306 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:52.535360 (+ 54us) server_negotiation.cc:299] Negotiation successful
0618 23:19:52.535374 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260618 23:19:52.536079 8919 leader_election.cc:302] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b5c8bddf83a427ca6a36ca49b21efc0, ab3dbcf249d343018ee0fe22ea00eca9; no voters:
I20260618 23:19:52.536196 9050 raft_consensus.cc:2781] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:19:52.536178 8853 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40bd828ebcd744f2bab1566f863133d7" candidate_uuid: "8b5c8bddf83a427ca6a36ca49b21efc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdb519a1510e441da517602402135c99" is_pre_election: true
I20260618 23:19:52.536254 9050 raft_consensus.cc:482] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:19:52.536283 9050 raft_consensus.cc:3037] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:52.536312 8853 raft_consensus.cc:2454] T 40bd828ebcd744f2bab1566f863133d7 P fdb519a1510e441da517602402135c99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b5c8bddf83a427ca6a36ca49b21efc0 in term 0.
I20260618 23:19:52.537060 9050 raft_consensus.cc:504] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b5c8bddf83a427ca6a36ca49b21efc0" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 44517 } } peers { permanent_uuid: "ab3dbcf249d343018ee0fe22ea00eca9" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45091 } } peers { permanent_uuid: "fdb519a1510e441da517602402135c99" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43271 } }
I20260618 23:19:52.537212 9050 leader_election.cc:288] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0 [CANDIDATE]: Term 1 election: Requested vote from peers ab3dbcf249d343018ee0fe22ea00eca9 (127.3.217.129:45091), fdb519a1510e441da517602402135c99 (127.3.217.130:43271)
I20260618 23:19:52.537461 8853 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40bd828ebcd744f2bab1566f863133d7" candidate_uuid: "8b5c8bddf83a427ca6a36ca49b21efc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdb519a1510e441da517602402135c99"
I20260618 23:19:52.537556 8853 raft_consensus.cc:3037] T 40bd828ebcd744f2bab1566f863133d7 P fdb519a1510e441da517602402135c99 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:52.537442 8722 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40bd828ebcd744f2bab1566f863133d7" candidate_uuid: "8b5c8bddf83a427ca6a36ca49b21efc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab3dbcf249d343018ee0fe22ea00eca9"
I20260618 23:19:52.537637 8722 raft_consensus.cc:3037] T 40bd828ebcd744f2bab1566f863133d7 P ab3dbcf249d343018ee0fe22ea00eca9 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:52.538365 8853 raft_consensus.cc:2454] T 40bd828ebcd744f2bab1566f863133d7 P fdb519a1510e441da517602402135c99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b5c8bddf83a427ca6a36ca49b21efc0 in term 1.
I20260618 23:19:52.538589 8920 leader_election.cc:302] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b5c8bddf83a427ca6a36ca49b21efc0, fdb519a1510e441da517602402135c99; no voters:
I20260618 23:19:52.538727 9050 raft_consensus.cc:2781] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:52.538899 9050 raft_consensus.cc:686] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0 [term 1 LEADER]: Becoming Leader. State: Replica: 8b5c8bddf83a427ca6a36ca49b21efc0, State: Running, Role: LEADER
I20260618 23:19:52.538998 9050 consensus_queue.cc:237] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b5c8bddf83a427ca6a36ca49b21efc0" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 44517 } } peers { permanent_uuid: "ab3dbcf249d343018ee0fe22ea00eca9" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45091 } } peers { permanent_uuid: "fdb519a1510e441da517602402135c99" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43271 } }
I20260618 23:19:52.539073 8722 raft_consensus.cc:2454] T 40bd828ebcd744f2bab1566f863133d7 P ab3dbcf249d343018ee0fe22ea00eca9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b5c8bddf83a427ca6a36ca49b21efc0 in term 1.
I20260618 23:19:52.539914 8579 catalog_manager.cc:5495] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b5c8bddf83a427ca6a36ca49b21efc0 (127.3.217.131). New cstate: current_term: 1 leader_uuid: "8b5c8bddf83a427ca6a36ca49b21efc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b5c8bddf83a427ca6a36ca49b21efc0" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 44517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab3dbcf249d343018ee0fe22ea00eca9" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdb519a1510e441da517602402135c99" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260618 23:19:52.545297 9041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.544161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41226 (local address 127.3.217.131:44517)
0618 23:19:52.544210 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:52.544211 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:52.544218 (+ 7us) server_negotiation.cc:407] Connection header received
0618 23:19:52.544240 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:52.544241 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:52.544249 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:52.544297 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:52.544835 (+ 538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:52.544835 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:52.544836 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:19:52.544839 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:52.544852 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:19:52.544856 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:52.544913 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:52.545242 (+ 329us) server_negotiation.cc:299] Negotiation successful
0618 23:19:52.545254 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260618 23:19:52.546824 8900 tablet.cc:2369] T 40bd828ebcd744f2bab1566f863133d7 P fdb519a1510e441da517602402135c99: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 23:19:52.547119 8853 raft_consensus.cc:1261] T 40bd828ebcd744f2bab1566f863133d7 P fdb519a1510e441da517602402135c99 [term 1 FOLLOWER]: Refusing update from remote peer 8b5c8bddf83a427ca6a36ca49b21efc0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:19:52.547194 8722 raft_consensus.cc:1261] T 40bd828ebcd744f2bab1566f863133d7 P ab3dbcf249d343018ee0fe22ea00eca9 [term 1 FOLLOWER]: Refusing update from remote peer 8b5c8bddf83a427ca6a36ca49b21efc0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:19:52.547462 9050 consensus_queue.cc:1035] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdb519a1510e441da517602402135c99" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:19:52.547820 9050 consensus_queue.cc:1035] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab3dbcf249d343018ee0fe22ea00eca9" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:19:52.550032 9057 mvcc.cc:205] Tried to move back new op lower bound from 7298354350270640128 to 7298354350240481280. Current Snapshot: MvccSnapshot[applied={T|T < 7298354350270640128}]
I20260618 23:19:52.550459 9058 mvcc.cc:205] Tried to move back new op lower bound from 7298354350270640128 to 7298354350240481280. Current Snapshot: MvccSnapshot[applied={T|T < 7298354350270640128}]
I20260618 23:19:52.552402 8579 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50612:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:19:52.552493 8579 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50612:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:19:52.553314 8579 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aa593c580daa48ee8ecddf5115e23e10: Sending DeleteTablet for 3 replicas of tablet 40bd828ebcd744f2bab1566f863133d7
I20260618 23:19:52.553602 8964 tablet_service.cc:1514] Processing DeleteTablet for tablet 40bd828ebcd744f2bab1566f863133d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:52 UTC) from {username='slave'} at 127.0.0.1:41222
I20260618 23:19:52.553814 9067 tablet_replica.cc:330] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0: stopping tablet replica
I20260618 23:19:52.553936 8702 tablet_service.cc:1514] Processing DeleteTablet for tablet 40bd828ebcd744f2bab1566f863133d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:52 UTC) from {username='slave'} at 127.0.0.1:48846
I20260618 23:19:52.553988 9067 raft_consensus.cc:2229] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0 [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:19:52.554121 9067 raft_consensus.cc:2258] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:52.554298 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 8640
I20260618 23:19:52.554353 8833 tablet_service.cc:1514] Processing DeleteTablet for tablet 40bd828ebcd744f2bab1566f863133d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:19:52 UTC) from {username='slave'} at 127.0.0.1:43350
I20260618 23:19:52.554792 9067 ts_tablet_manager.cc:1905] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:19:52.556469 9067 ts_tablet_manager.cc:1918] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:19:52.556543 9067 log.cc:1196] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/40bd828ebcd744f2bab1566f863133d7
I20260618 23:19:52.556808 9067 ts_tablet_manager.cc:1939] T 40bd828ebcd744f2bab1566f863133d7 P 8b5c8bddf83a427ca6a36ca49b21efc0: Deleting consensus metadata
I20260618 23:19:52.557224 8564 catalog_manager.cc:4841] TS 8b5c8bddf83a427ca6a36ca49b21efc0 (127.3.217.131:44517): tablet 40bd828ebcd744f2bab1566f863133d7 (table test-table [id=cf2de2ab6532415b9de684f3604cbba8]) successfully deleted
I20260618 23:19:52.558851 9069 tablet_replica.cc:330] T 40bd828ebcd744f2bab1566f863133d7 P fdb519a1510e441da517602402135c99: stopping tablet replica
I20260618 23:19:52.558976 9069 raft_consensus.cc:2229] T 40bd828ebcd744f2bab1566f863133d7 P fdb519a1510e441da517602402135c99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:19:52.559090 9069 raft_consensus.cc:2258] T 40bd828ebcd744f2bab1566f863133d7 P fdb519a1510e441da517602402135c99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:52.559542 9069 ts_tablet_manager.cc:1905] T 40bd828ebcd744f2bab1566f863133d7 P fdb519a1510e441da517602402135c99: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260618 23:19:52.561427 8566 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.217.129:45091 (error 108)
I20260618 23:19:52.561578 9069 ts_tablet_manager.cc:1918] T 40bd828ebcd744f2bab1566f863133d7 P fdb519a1510e441da517602402135c99: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:19:52.561581 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 8771
I20260618 23:19:52.561641 9069 log.cc:1196] T 40bd828ebcd744f2bab1566f863133d7 P fdb519a1510e441da517602402135c99: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/40bd828ebcd744f2bab1566f863133d7
I20260618 23:19:52.561889 9069 ts_tablet_manager.cc:1939] T 40bd828ebcd744f2bab1566f863133d7 P fdb519a1510e441da517602402135c99: Deleting consensus metadata
I20260618 23:19:52.561977 9039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.561865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:45091 (local address 127.0.0.1:48852)
0618 23:19:52.561906 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:52.561935 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.129:45091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260618 23:19:52.562423 8566 catalog_manager.cc:4584] TS ab3dbcf249d343018ee0fe22ea00eca9 (127.3.217.129:45091): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 40bd828ebcd744f2bab1566f863133d7: Network error: Client connection negotiation failed: client connection to 127.3.217.129:45091: connect: Connection refused (error 111)
I20260618 23:19:52.566883 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 8902
I20260618 23:19:52.566953 9039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.566833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:43271 (local address 127.0.0.1:43352)
0618 23:19:52.566900 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:52.566923 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.130:43271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260618 23:19:52.572000 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 8549
2026-06-18T23:19:52Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (690 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260618 23:19:52.592592 3942 mini_oidc.cc:152] Starting JWKS server
I20260618 23:19:52.593657 3942 webserver.cc:460] Webserver started at https://127.0.0.1:37545/ using document root <none> and password file <none>
I20260618 23:19:52.593779 3942 mini_oidc.cc:189] Starting OIDC Discovery server
I20260618 23:19:52.593968 3942 webserver.cc:460] Webserver started at http://127.0.0.1:42813/ using document root <none> and password file <none>
2026-06-18T23:19:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:19:52Z Disabled control of system clock
I20260618 23:19:52.602350 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:41743
--webserver_interface=127.3.217.190
--webserver_port=0
--builtin_ntp_servers=127.3.217.148:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:41743
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37545/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781824769284800-3942-0/testchainca.cert with env {}
W20260618 23:19:52.681089 9076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:52.681288 9076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:52.681311 9076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:52.682476 9076 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:19:52.682518 9076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:52.682530 9076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:52.682543 9076 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:19:52.682556 9076 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260618 23:19:52.682569 9076 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260618 23:19:52.682610 9076 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37545/jwks.json
I20260618 23:19:52.684211 9076 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:41743
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:41743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37545/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781824769284800-3942-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9076
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:52.684476 9076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:52.684707 9076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:52.689810 9082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:52.689823 9084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:52.689831 9081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:52.690383 9076 server_base.cc:1034] running on GCE node
I20260618 23:19:52.690649 9076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:52.690991 9076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:52.692186 9076 hybrid_clock.cc:648] HybridClock initialized: now 1781824792692170 us; error 31 us; skew 500 ppm
I20260618 23:19:52.693565 9076 webserver.cc:460] Webserver started at http://127.3.217.190:38047/ using document root <none> and password file <none>
I20260618 23:19:52.693835 9076 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:52.693958 9076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:52.694120 9076 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:52.695355 9076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "b8cc7e7c1ba24fdfa0a1a098167c4593"
format_stamp: "Formatted at 2026-06-18 23:19:52 on dist-test-slave-r9ct"
server_key: "cbc3d9647d51236278970563d71931bd"
server_key_iv: "4f352e6f57988db90026632128ee484a"
server_key_version: "encryptionkey@0"
I20260618 23:19:52.695734 9076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "b8cc7e7c1ba24fdfa0a1a098167c4593"
format_stamp: "Formatted at 2026-06-18 23:19:52 on dist-test-slave-r9ct"
server_key: "cbc3d9647d51236278970563d71931bd"
server_key_iv: "4f352e6f57988db90026632128ee484a"
server_key_version: "encryptionkey@0"
I20260618 23:19:52.697386 9076 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260618 23:19:52.698351 9090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:52.698666 9076 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:52.698982 9076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "b8cc7e7c1ba24fdfa0a1a098167c4593"
format_stamp: "Formatted at 2026-06-18 23:19:52 on dist-test-slave-r9ct"
server_key: "cbc3d9647d51236278970563d71931bd"
server_key_iv: "4f352e6f57988db90026632128ee484a"
server_key_version: "encryptionkey@0"
I20260618 23:19:52.699070 9076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:52.712736 9076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:52.713148 9076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:52.713310 9076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:52.718195 9076 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:41743
I20260618 23:19:52.718268 9142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:41743 every 8 connection(s)
I20260618 23:19:52.718658 9076 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:19:52.719740 9143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:52.722107 9143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593: Bootstrap starting.
I20260618 23:19:52.722748 9143 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:52.723060 9143 log.cc:824] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:52.723858 9143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593: No bootstrap required, opened a new log
I20260618 23:19:52.725471 9143 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8cc7e7c1ba24fdfa0a1a098167c4593" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41743 } }
I20260618 23:19:52.725621 9143 raft_consensus.cc:374] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:52.725646 9143 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8cc7e7c1ba24fdfa0a1a098167c4593, State: Initialized, Role: FOLLOWER
I20260618 23:19:52.725824 9143 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8cc7e7c1ba24fdfa0a1a098167c4593" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41743 } }
I20260618 23:19:52.725993 9143 raft_consensus.cc:388] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:19:52.726145 9143 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:19:52.726184 9143 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:52.726784 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 9076
I20260618 23:19:52.726905 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:19:52.726907 9143 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8cc7e7c1ba24fdfa0a1a098167c4593" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41743 } }
I20260618 23:19:52.727011 9143 leader_election.cc:302] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8cc7e7c1ba24fdfa0a1a098167c4593; no voters:
I20260618 23:19:52.727114 3942 external_mini_cluster.cc:1428] Setting key e1e9f34e577b094852bd2f49fd331b97
I20260618 23:19:52.727203 9143 leader_election.cc:288] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:19:52.727391 9146 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:52.727475 9143 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:19:52.727651 9146 raft_consensus.cc:686] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593 [term 1 LEADER]: Becoming Leader. State: Replica: b8cc7e7c1ba24fdfa0a1a098167c4593, State: Running, Role: LEADER
I20260618 23:19:52.727777 9146 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8cc7e7c1ba24fdfa0a1a098167c4593" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41743 } }
I20260618 23:19:52.729161 9147 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b8cc7e7c1ba24fdfa0a1a098167c4593" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8cc7e7c1ba24fdfa0a1a098167c4593" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41743 } } }
I20260618 23:19:52.729277 9147 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593 [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:52.729535 9160 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:19:52.729599 9149 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8cc7e7c1ba24fdfa0a1a098167c4593. Latest consensus state: current_term: 1 leader_uuid: "b8cc7e7c1ba24fdfa0a1a098167c4593" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8cc7e7c1ba24fdfa0a1a098167c4593" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41743 } } }
I20260618 23:19:52.729677 9149 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593 [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:52.730134 9160 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:19:52.732188 9160 catalog_manager.cc:1347] Generated new cluster ID: 01e1d2edfd324fc9aec171717ad15d55
I20260618 23:19:52.732264 9160 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:19:52.734705 9150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.727690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38210 (local address 127.3.217.190:41743)
0618 23:19:52.727950 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:52.727961 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:52.728306 (+ 345us) server_negotiation.cc:407] Connection header received
0618 23:19:52.728603 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:52.728614 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:52.728698 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:52.728884 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:52.729368 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:52.730839 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:52.732086 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:52.732943 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:52.733111 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:52.733952 (+ 841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:52.733956 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:52.733957 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:19:52.734172 (+ 215us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:52.734216 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:19:52.734233 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:52.734310 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:52.734392 (+ 82us) server_negotiation.cc:299] Negotiation successful
0618 23:19:52.734481 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":100,"threads_started":1}
I20260618 23:19:52.735615 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:19:52.748677 9160 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:19:52.749212 9160 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:19:52.755005 9160 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b8cc7e7c1ba24fdfa0a1a098167c4593: Generated new TSK 0
I20260618 23:19:52.755280 9160 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260618 23:19:52.786131 9173 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260618 23:19:52.786245 9173 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260618 23:19:52.786500 9150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.767752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38222 (local address 127.3.217.190:41743)
0618 23:19:52.767815 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:52.767817 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:52.767995 (+ 178us) server_negotiation.cc:407] Connection header received
0618 23:19:52.768124 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:52.768125 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:52.768138 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:52.768233 (+ 95us) server_negotiation.cc:226] Negotiated authn=JWT
0618 23:19:52.768499 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:52.769098 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:52.769891 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:52.770097 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:52.770177 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:52.770375 (+ 198us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0618 23:19:52.786271 (+ 15896us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37545/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0618 23:19:52.786436 (+ 165us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38222: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37545/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":38}
W20260618 23:19:52.786552 9150 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38222: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37545/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260618 23:19:52.786890 9172 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:19:52.767693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:41743 (local address 127.0.0.1:38222)
0618 23:19:52.767927 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:52.767937 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:52.768016 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:52.768240 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:52.768240 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:52.768242 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0618 23:19:52.768307 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:52.768309 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:52.769212 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:52.769213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:52.769803 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:52.769805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:52.770178 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:52.770179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:52.770240 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:52.770258 (+ 18us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0618 23:19:52.786430 (+ 16172us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37545/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0618 23:19:52.786538 (+ 108us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.3.217.190:41743: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37545/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":98,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.3.217.190:41743: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37545/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260618 23:19:52.787312 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 9076
2026-06-18T23:19:52Z chronyd exiting
I20260618 23:19:52.824554 3942 test_util.cc:175] -----------------------------------------------
I20260618 23:19:52.824632 3942 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781824769284800-3942-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (232 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260618 23:19:52.825343 3942 mini_oidc.cc:152] Starting JWKS server
I20260618 23:19:52.826010 3942 webserver.cc:460] Webserver started at https://127.0.0.1:42569/ using document root <none> and password file <none>
I20260618 23:19:52.826056 3942 mini_oidc.cc:189] Starting OIDC Discovery server
I20260618 23:19:52.826217 3942 webserver.cc:460] Webserver started at http://127.0.0.1:35253/ using document root <none> and password file <none>
2026-06-18T23:19:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:19:52Z Disabled control of system clock
I20260618 23:19:52.835121 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:41653
--webserver_interface=127.3.217.190
--webserver_port=0
--builtin_ntp_servers=127.3.217.148:37061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:41653
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42569/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781824769284800-3942-0/testchainca.cert with env {}
W20260618 23:19:52.917254 9179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:52.917457 9179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:52.917479 9179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:52.919121 9179 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:19:52.919171 9179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:52.919185 9179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:52.919198 9179 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:19:52.919210 9179 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260618 23:19:52.919224 9179 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260618 23:19:52.919234 9179 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42569/jwks.json
I20260618 23:19:52.920718 9179 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:37061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:41653
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:41653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42569/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781824769284800-3942-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9179
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:52.920902 9179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:52.921069 9179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:52.926043 9187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:52.926095 9179 server_base.cc:1034] running on GCE node
W20260618 23:19:52.926057 9185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:52.926052 9184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:52.926520 9179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:52.926872 9179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:52.928133 9179 hybrid_clock.cc:648] HybridClock initialized: now 1781824792928078 us; error 64 us; skew 500 ppm
I20260618 23:19:52.929987 9179 webserver.cc:460] Webserver started at http://127.3.217.190:39445/ using document root <none> and password file <none>
I20260618 23:19:52.930243 9179 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:52.930315 9179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:52.930442 9179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:52.931545 9179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "320084e1b8d44ac6a13a82cdfcec81c4"
format_stamp: "Formatted at 2026-06-18 23:19:52 on dist-test-slave-r9ct"
server_key: "cba361470b988543ed298f1e9e87e9c9"
server_key_iv: "e9cafdf86ae4f48ade58c36fe572a8c2"
server_key_version: "encryptionkey@0"
I20260618 23:19:52.931915 9179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "320084e1b8d44ac6a13a82cdfcec81c4"
format_stamp: "Formatted at 2026-06-18 23:19:52 on dist-test-slave-r9ct"
server_key: "cba361470b988543ed298f1e9e87e9c9"
server_key_iv: "e9cafdf86ae4f48ade58c36fe572a8c2"
server_key_version: "encryptionkey@0"
I20260618 23:19:52.933437 9179 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260618 23:19:52.934409 9193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:52.934803 9179 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:19:52.934940 9179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "320084e1b8d44ac6a13a82cdfcec81c4"
format_stamp: "Formatted at 2026-06-18 23:19:52 on dist-test-slave-r9ct"
server_key: "cba361470b988543ed298f1e9e87e9c9"
server_key_iv: "e9cafdf86ae4f48ade58c36fe572a8c2"
server_key_version: "encryptionkey@0"
I20260618 23:19:52.935043 9179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:52.951182 9179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:52.951495 9179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:52.951650 9179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:52.955672 9179 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:41653
I20260618 23:19:52.955705 9245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:41653 every 8 connection(s)
I20260618 23:19:52.956044 9179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:19:52.957026 9246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:52.959313 9246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4: Bootstrap starting.
I20260618 23:19:52.959497 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 9179
I20260618 23:19:52.959620 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:19:52.959802 3942 external_mini_cluster.cc:1428] Setting key e1894b6d21b2af69c703a534b4adc3e3
I20260618 23:19:52.960014 9246 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:52.960330 9246 log.cc:824] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:52.961001 9246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4: No bootstrap required, opened a new log
I20260618 23:19:52.962695 9246 raft_consensus.cc:348] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "320084e1b8d44ac6a13a82cdfcec81c4" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41653 } }
I20260618 23:19:52.962910 9246 raft_consensus.cc:374] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:52.962957 9246 raft_consensus.cc:729] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 320084e1b8d44ac6a13a82cdfcec81c4, State: Initialized, Role: FOLLOWER
I20260618 23:19:52.963078 9246 consensus_queue.cc:260] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "320084e1b8d44ac6a13a82cdfcec81c4" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41653 } }
I20260618 23:19:52.963171 9246 raft_consensus.cc:388] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:19:52.963207 9246 raft_consensus.cc:482] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:19:52.963253 9246 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:52.963758 9246 raft_consensus.cc:504] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "320084e1b8d44ac6a13a82cdfcec81c4" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41653 } }
I20260618 23:19:52.963946 9246 leader_election.cc:302] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 320084e1b8d44ac6a13a82cdfcec81c4; no voters:
I20260618 23:19:52.964162 9246 leader_election.cc:288] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:19:52.964187 9251 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:52.964322 9251 raft_consensus.cc:686] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4 [term 1 LEADER]: Becoming Leader. State: Replica: 320084e1b8d44ac6a13a82cdfcec81c4, State: Running, Role: LEADER
I20260618 23:19:52.964432 9246 sys_catalog.cc:564] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:19:52.964414 9251 consensus_queue.cc:237] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "320084e1b8d44ac6a13a82cdfcec81c4" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41653 } }
I20260618 23:19:52.964735 9251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 320084e1b8d44ac6a13a82cdfcec81c4. Latest consensus state: current_term: 1 leader_uuid: "320084e1b8d44ac6a13a82cdfcec81c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "320084e1b8d44ac6a13a82cdfcec81c4" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41653 } } }
I20260618 23:19:52.964745 9252 sys_catalog.cc:455] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "320084e1b8d44ac6a13a82cdfcec81c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "320084e1b8d44ac6a13a82cdfcec81c4" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41653 } } }
I20260618 23:19:52.964821 9251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4 [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:52.964828 9252 sys_catalog.cc:458] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4 [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:52.965035 9256 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:19:52.965323 9249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.960261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39160 (local address 127.3.217.190:41653)
0618 23:19:52.960463 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:52.960471 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:52.960504 (+ 33us) server_negotiation.cc:407] Connection header received
0618 23:19:52.960929 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:52.960935 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:52.960988 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:52.961139 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:52.961334 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:52.962159 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:52.963236 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:52.963678 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:52.963804 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:52.964495 (+ 691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:52.964499 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:52.964500 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:19:52.964710 (+ 210us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:52.964749 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:19:52.964764 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:52.964820 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:52.965026 (+ 206us) server_negotiation.cc:299] Negotiation successful
0618 23:19:52.965121 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":76,"threads_started":1}
I20260618 23:19:52.965526 9256 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:19:52.966413 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:19:52.967829 9256 catalog_manager.cc:1347] Generated new cluster ID: f311c34c5170436b97d5da902926afb5
I20260618 23:19:52.967885 9256 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:19:52.974088 9256 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:19:52.974833 9256 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:19:52.980717 9256 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 320084e1b8d44ac6a13a82cdfcec81c4: Generated new TSK 0
I20260618 23:19:52.980912 9256 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260618 23:19:53.004244 9276 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260618 23:19:53.004448 9276 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260618 23:19:53.004648 9249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:52.988507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39170 (local address 127.3.217.190:41653)
0618 23:19:52.988571 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:52.988573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:52.988665 (+ 92us) server_negotiation.cc:407] Connection header received
0618 23:19:52.988720 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:52.988721 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:52.988733 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:52.988818 (+ 85us) server_negotiation.cc:226] Negotiated authn=JWT
0618 23:19:52.989361 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:52.990164 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:52.991050 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:52.991395 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:52.991481 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:52.991741 (+ 260us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0618 23:19:53.004411 (+ 12670us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42569/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0618 23:19:53.004574 (+ 163us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39170: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42569/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":39}
W20260618 23:19:53.004711 9249 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39170: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42569/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260618 23:19:53.004930 9275 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:19:52.988403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:41653 (local address 127.0.0.1:39170)
0618 23:19:52.988597 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:52.988605 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:52.988663 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:52.988957 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:52.988959 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:52.988963 (+ 4us) client_negotiation.cc:189] Negotiated authn=JWT
0618 23:19:52.989057 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:52.989059 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:52.990290 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:52.990292 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:52.990967 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:52.990970 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:52.991530 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:52.991532 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:52.991603 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:52.991611 (+ 8us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0618 23:19:53.004611 (+ 13000us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42569/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0618 23:19:53.004746 (+ 135us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.3.217.190:41653: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42569/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":125,"threads_started":1}
I20260618 23:19:53.005409 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 9179
2026-06-18T23:19:53Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (217 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260618 23:19:53.043381 3942 mini_oidc.cc:152] Starting JWKS server
I20260618 23:19:53.044085 3942 webserver.cc:460] Webserver started at https://127.0.0.1:42365/ using document root <none> and password file <none>
I20260618 23:19:53.044153 3942 mini_oidc.cc:189] Starting OIDC Discovery server
I20260618 23:19:53.044308 3942 webserver.cc:460] Webserver started at http://127.0.0.1:40669/ using document root <none> and password file <none>
2026-06-18T23:19:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:19:53Z Disabled control of system clock
I20260618 23:19:53.053009 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:35735
--webserver_interface=127.3.217.190
--webserver_port=0
--builtin_ntp_servers=127.3.217.148:34175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:35735
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42365/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260618 23:19:53.137036 9282 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:53.137245 9282 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:53.137270 9282 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:53.138517 9282 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:19:53.138562 9282 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:53.138576 9282 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:53.138588 9282 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:19:53.138600 9282 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260618 23:19:53.138612 9282 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260618 23:19:53.138624 9282 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42365/jwks.json
I20260618 23:19:53.140043 9282 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:34175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:35735
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:35735
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42365/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9282
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:53.140300 9282 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:53.140604 9282 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:53.145393 9290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:53.145455 9288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:53.145457 9287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:53.145682 9282 server_base.cc:1034] running on GCE node
I20260618 23:19:53.145972 9282 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:53.146199 9282 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:53.147336 9282 hybrid_clock.cc:648] HybridClock initialized: now 1781824793147321 us; error 29 us; skew 500 ppm
I20260618 23:19:53.148586 9282 webserver.cc:460] Webserver started at http://127.3.217.190:35915/ using document root <none> and password file <none>
I20260618 23:19:53.148818 9282 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:53.148869 9282 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:53.149034 9282 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:53.150095 9282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "747ffd2dc584420a8522fa8d76acc822"
format_stamp: "Formatted at 2026-06-18 23:19:53 on dist-test-slave-r9ct"
server_key: "98f861af00bd2d978b93b430da4a0361"
server_key_iv: "c8d8117618347364e6dfd6d05df32e42"
server_key_version: "encryptionkey@0"
I20260618 23:19:53.150447 9282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "747ffd2dc584420a8522fa8d76acc822"
format_stamp: "Formatted at 2026-06-18 23:19:53 on dist-test-slave-r9ct"
server_key: "98f861af00bd2d978b93b430da4a0361"
server_key_iv: "c8d8117618347364e6dfd6d05df32e42"
server_key_version: "encryptionkey@0"
I20260618 23:19:53.151785 9282 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:19:53.152580 9296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:53.152756 9282 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:53.152853 9282 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "747ffd2dc584420a8522fa8d76acc822"
format_stamp: "Formatted at 2026-06-18 23:19:53 on dist-test-slave-r9ct"
server_key: "98f861af00bd2d978b93b430da4a0361"
server_key_iv: "c8d8117618347364e6dfd6d05df32e42"
server_key_version: "encryptionkey@0"
I20260618 23:19:53.152964 9282 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:53.169495 9282 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:53.169790 9282 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:53.169941 9282 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:53.174705 9282 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:35735
I20260618 23:19:53.174934 9348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:35735 every 8 connection(s)
I20260618 23:19:53.175354 9282 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:19:53.176267 9349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:53.178566 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 9282
I20260618 23:19:53.178686 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:19:53.178938 3942 external_mini_cluster.cc:1428] Setting key b2d24b852a9707bda1b99e1af060294b
I20260618 23:19:53.180193 9349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822: Bootstrap starting.
I20260618 23:19:53.180938 9349 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:53.181238 9349 log.cc:824] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:53.181943 9349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822: No bootstrap required, opened a new log
I20260618 23:19:53.184333 9349 raft_consensus.cc:348] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "747ffd2dc584420a8522fa8d76acc822" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 35735 } }
I20260618 23:19:53.184487 9349 raft_consensus.cc:374] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:53.184530 9349 raft_consensus.cc:729] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 747ffd2dc584420a8522fa8d76acc822, State: Initialized, Role: FOLLOWER
I20260618 23:19:53.184676 9349 consensus_queue.cc:260] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "747ffd2dc584420a8522fa8d76acc822" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 35735 } }
I20260618 23:19:53.184764 9349 raft_consensus.cc:388] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:19:53.184806 9349 raft_consensus.cc:482] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:19:53.184854 9349 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:53.185051 9352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:53.179469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60278 (local address 127.3.217.190:35735)
0618 23:19:53.179685 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:53.179695 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:53.179730 (+ 35us) server_negotiation.cc:407] Connection header received
0618 23:19:53.180273 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:53.180282 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:53.180369 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:53.180517 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:53.180678 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:53.181919 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:53.183022 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:53.183446 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:53.183553 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:53.184240 (+ 687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:53.184243 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:53.184243 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:19:53.184421 (+ 178us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:53.184451 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:19:53.184462 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:53.184555 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:53.184654 (+ 99us) server_negotiation.cc:299] Negotiation successful
0618 23:19:53.184841 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":82,"threads_started":1}
I20260618 23:19:53.185498 9349 raft_consensus.cc:504] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "747ffd2dc584420a8522fa8d76acc822" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 35735 } }
I20260618 23:19:53.185613 9349 leader_election.cc:302] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 747ffd2dc584420a8522fa8d76acc822; no voters:
I20260618 23:19:53.185783 9349 leader_election.cc:288] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:19:53.185817 9354 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:53.185961 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:19:53.185986 9354 raft_consensus.cc:686] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822 [term 1 LEADER]: Becoming Leader. State: Replica: 747ffd2dc584420a8522fa8d76acc822, State: Running, Role: LEADER
I20260618 23:19:53.186023 9349 sys_catalog.cc:564] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:19:53.186066 9354 consensus_queue.cc:237] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "747ffd2dc584420a8522fa8d76acc822" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 35735 } }
I20260618 23:19:53.186354 9354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 747ffd2dc584420a8522fa8d76acc822. Latest consensus state: current_term: 1 leader_uuid: "747ffd2dc584420a8522fa8d76acc822" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "747ffd2dc584420a8522fa8d76acc822" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 35735 } } }
I20260618 23:19:53.186419 9354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822 [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:53.186471 9356 sys_catalog.cc:455] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "747ffd2dc584420a8522fa8d76acc822" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "747ffd2dc584420a8522fa8d76acc822" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 35735 } } }
I20260618 23:19:53.186556 9356 sys_catalog.cc:458] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822 [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:53.186605 9360 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:19:53.187099 9360 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:19:53.188980 9360 catalog_manager.cc:1347] Generated new cluster ID: 697a4aa9e800436fa029c361c0cf6ebf
I20260618 23:19:53.189034 9360 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:19:53.208168 9360 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:19:53.208875 9360 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:19:53.218910 9360 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 747ffd2dc584420a8522fa8d76acc822: Generated new TSK 0
I20260618 23:19:53.219090 9360 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:19:53.237274 9352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:53.233490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60282 (local address 127.3.217.190:35735)
0618 23:19:53.233548 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:53.233550 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:53.233647 (+ 97us) server_negotiation.cc:407] Connection header received
0618 23:19:53.233698 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:53.233699 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:53.233711 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:53.233790 (+ 79us) server_negotiation.cc:226] Negotiated authn=JWT
0618 23:19:53.234052 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:53.234849 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:53.235623 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:53.235936 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:53.236007 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:53.236160 (+ 153us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0618 23:19:53.237073 (+ 913us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42365/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0618 23:19:53.237203 (+ 130us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60282: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42365/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":34}
W20260618 23:19:53.237336 9352 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60282: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42365/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260618 23:19:53.237382 9378 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:19:53.233402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:35735 (local address 127.0.0.1:60282)
0618 23:19:53.233571 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:53.233581 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:53.233643 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:53.233855 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:53.233914 (+ 59us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:53.233918 (+ 4us) client_negotiation.cc:189] Negotiated authn=JWT
0618 23:19:53.233970 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:53.233972 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:53.234965 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:53.234966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:53.235547 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:53.235549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:53.236018 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:53.236019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:53.236060 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:53.236065 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0618 23:19:53.237177 (+ 1112us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42365/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0618 23:19:53.237270 (+ 93us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.3.217.190:35735: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42365/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":102,"threads_started":1}
I20260618 23:19:53.237776 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 9282
E20260618 23:19:53.249184 9379 webserver.cc:533] Webserver: sslize failed:
E20260618 23:19:53.249258 9379 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-06-18T23:19:53Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (232 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-06-18T23:19:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:19:53Z Disabled control of system clock
I20260618 23:19:53.284219 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:38371
--webserver_interface=127.3.217.190
--webserver_port=0
--builtin_ntp_servers=127.3.217.148:41971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:38371
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781824769284800-3942-0/testchainca.cert with env {}
W20260618 23:19:53.367328 9383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:53.367533 9383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:53.367555 9383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:53.368917 9383 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:19:53.369014 9383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:53.369027 9383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:53.369041 9383 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:19:53.369053 9383 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260618 23:19:53.369066 9383 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260618 23:19:53.369082 9383 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260618 23:19:53.370637 9383 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:41971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:38371
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:38371
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781824769284800-3942-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9383
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:53.370852 9383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:53.371018 9383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:53.376300 9389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:53.376286 9391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:53.376317 9383 server_base.cc:1034] running on GCE node
W20260618 23:19:53.376284 9388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:53.376662 9383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:53.376976 9383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:53.378159 9383 hybrid_clock.cc:648] HybridClock initialized: now 1781824793378116 us; error 66 us; skew 500 ppm
I20260618 23:19:53.379860 9383 webserver.cc:460] Webserver started at http://127.3.217.190:43453/ using document root <none> and password file <none>
I20260618 23:19:53.380141 9383 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:53.380195 9383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:53.380307 9383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:53.381587 9383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "c9971e047c774598a0e05550c705e107"
format_stamp: "Formatted at 2026-06-18 23:19:53 on dist-test-slave-r9ct"
server_key: "74fa59471c6ab6de5436206db60c55e3"
server_key_iv: "5ee971ba2f98d2cb896a25d7e6b7a57d"
server_key_version: "encryptionkey@0"
I20260618 23:19:53.382123 9383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "c9971e047c774598a0e05550c705e107"
format_stamp: "Formatted at 2026-06-18 23:19:53 on dist-test-slave-r9ct"
server_key: "74fa59471c6ab6de5436206db60c55e3"
server_key_iv: "5ee971ba2f98d2cb896a25d7e6b7a57d"
server_key_version: "encryptionkey@0"
I20260618 23:19:53.384014 9383 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260618 23:19:53.385061 9397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:53.385356 9383 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:19:53.385473 9383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "c9971e047c774598a0e05550c705e107"
format_stamp: "Formatted at 2026-06-18 23:19:53 on dist-test-slave-r9ct"
server_key: "74fa59471c6ab6de5436206db60c55e3"
server_key_iv: "5ee971ba2f98d2cb896a25d7e6b7a57d"
server_key_version: "encryptionkey@0"
I20260618 23:19:53.385579 9383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:53.399752 9383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:53.400203 9383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:53.400369 9383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:53.405719 9383 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:38371
I20260618 23:19:53.405920 9449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:38371 every 8 connection(s)
I20260618 23:19:53.406354 9383 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:19:53.407496 9450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:53.409502 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 9383
I20260618 23:19:53.409595 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:19:53.409759 3942 external_mini_cluster.cc:1428] Setting key 5ed0736d36409cf47e1c0a479c267fc9
I20260618 23:19:53.410095 9450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107: Bootstrap starting.
I20260618 23:19:53.410825 9450 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:53.411123 9450 log.cc:824] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:53.411892 9450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107: No bootstrap required, opened a new log
I20260618 23:19:53.414031 9450 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9971e047c774598a0e05550c705e107" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38371 } }
I20260618 23:19:53.414158 9450 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:53.414180 9450 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9971e047c774598a0e05550c705e107, State: Initialized, Role: FOLLOWER
I20260618 23:19:53.414311 9450 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9971e047c774598a0e05550c705e107" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38371 } }
I20260618 23:19:53.414371 9450 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:19:53.414391 9450 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:19:53.414456 9450 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:53.415165 9450 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9971e047c774598a0e05550c705e107" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38371 } }
I20260618 23:19:53.415275 9450 leader_election.cc:302] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9971e047c774598a0e05550c705e107; no voters:
I20260618 23:19:53.415473 9450 leader_election.cc:288] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:19:53.415495 9455 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:53.415601 9455 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107 [term 1 LEADER]: Becoming Leader. State: Replica: c9971e047c774598a0e05550c705e107, State: Running, Role: LEADER
I20260618 23:19:53.415678 9455 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9971e047c774598a0e05550c705e107" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38371 } }
I20260618 23:19:53.415729 9450 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:19:53.415975 9455 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9971e047c774598a0e05550c705e107. Latest consensus state: current_term: 1 leader_uuid: "c9971e047c774598a0e05550c705e107" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9971e047c774598a0e05550c705e107" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38371 } } }
I20260618 23:19:53.416038 9455 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107 [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:53.416183 9456 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9971e047c774598a0e05550c705e107" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9971e047c774598a0e05550c705e107" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38371 } } }
I20260618 23:19:53.416270 9456 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107 [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:53.416429 9459 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:19:53.416899 9459 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:19:53.417114 9453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:53.410273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44050 (local address 127.3.217.190:38371)
0618 23:19:53.410499 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:53.410507 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:53.410546 (+ 39us) server_negotiation.cc:407] Connection header received
0618 23:19:53.411080 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:53.411087 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:53.411145 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:53.411284 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:53.411511 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:53.412651 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:53.413872 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:53.414407 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:53.414553 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:53.415482 (+ 929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:53.415486 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:53.415486 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:19:53.415719 (+ 233us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:53.415760 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:19:53.415774 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:53.416014 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:53.416050 (+ 36us) server_negotiation.cc:299] Negotiation successful
0618 23:19:53.416131 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":87,"threads_started":1}
I20260618 23:19:53.418166 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:19:53.419229 9459 catalog_manager.cc:1347] Generated new cluster ID: 17c42bd5c3e64e0db64d0008e48fd422
I20260618 23:19:53.419327 9459 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:19:53.426187 9459 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:19:53.426771 9459 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:19:53.432439 9459 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9971e047c774598a0e05550c705e107: Generated new TSK 0
I20260618 23:19:53.432651 9459 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:19:53.547725 9453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:53.440478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44058 (local address 127.3.217.190:38371)
0618 23:19:53.440541 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:53.440543 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:53.440653 (+ 110us) server_negotiation.cc:407] Connection header received
0618 23:19:53.440740 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:53.440741 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:53.440753 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:53.440846 (+ 93us) server_negotiation.cc:226] Negotiated authn=JWT
0618 23:19:53.440965 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:53.441451 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:53.442312 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:53.442533 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:53.442609 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:53.442825 (+ 216us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0618 23:19:53.547420 (+104595us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0618 23:19:53.547639 (+ 219us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44058: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":39}
W20260618 23:19:53.547809 9453 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44058: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260618 23:19:53.547823 9479 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:19:53.440428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:38371 (local address 127.0.0.1:44058)
0618 23:19:53.440580 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:53.440590 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:53.440670 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:53.440847 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:53.440847 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:53.440849 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0618 23:19:53.440901 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:53.440902 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:53.441549 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:53.441550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:53.442220 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:53.442222 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:53.442612 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:53.442613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:53.442668 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:53.442673 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0618 23:19:53.547587 (+104914us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0618 23:19:53.547705 (+ 118us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.3.217.190:38371: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":73,"threads_started":1}
I20260618 23:19:53.548192 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 9383
2026-06-18T23:19:53Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (290 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (90 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (92 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:19:53 dist-test-slave-r9ct krb5kdc[9491](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:19:53 dist-test-slave-r9ct krb5kdc[9491](info): set up 2 sockets
Jun 18 23:19:53 dist-test-slave-r9ct krb5kdc[9491](info): commencing operation
krb5kdc: starting...
W20260618 23:19:54.894907 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.145s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260618 23:19:55.205714 3942 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.311s user 0.000s sys 0.001s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260618 23:19:55.421538 3942 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.216s user 0.000s sys 0.002s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260618 23:19:55.644465 3942 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.223s user 0.000s sys 0.002s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/test-user.keytab.
W20260618 23:19:56.610679 3942 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.966s user 0.000s sys 0.002s
Jun 18 23:19:56 dist-test-slave-r9ct krb5kdc[9491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:19:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:19:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:19:56.664088 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:33505
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:39763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:33505
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:56.748139 9504 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:56.748368 9504 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:56.748392 9504 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:56.749697 9504 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:19:56.749740 9504 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:56.749755 9504 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:56.749768 9504 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:19:56.749809 9504 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:19:56.751320 9504 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:39763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:33505
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:33505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9504
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:56.751509 9504 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:56.751670 9504 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:56.756757 9512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:56.756760 9510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:56.757100 9504 server_base.cc:1034] running on GCE node
W20260618 23:19:56.757068 9509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:56.757571 9504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:56.757858 9504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:56.759095 9504 hybrid_clock.cc:648] HybridClock initialized: now 1781824796759065 us; error 67 us; skew 500 ppm
Jun 18 23:19:56 dist-test-slave-r9ct krb5kdc[9491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824796, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:56.765676 9504 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:19:56.766208 9504 webserver.cc:460] Webserver started at http://127.3.217.190:37991/ using document root <none> and password file <none>
I20260618 23:19:56.766450 9504 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:56.766521 9504 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:56.766675 9504 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:56.767807 9504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "10f7731196154d00b75869c1fa161906"
format_stamp: "Formatted at 2026-06-18 23:19:56 on dist-test-slave-r9ct"
server_key: "c979bce4b193e2aadec16fd850b1cdf2"
server_key_iv: "e8184bd5485da6b7a322ddf2bf94a6ee"
server_key_version: "encryptionkey@0"
I20260618 23:19:56.768182 9504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "10f7731196154d00b75869c1fa161906"
format_stamp: "Formatted at 2026-06-18 23:19:56 on dist-test-slave-r9ct"
server_key: "c979bce4b193e2aadec16fd850b1cdf2"
server_key_iv: "e8184bd5485da6b7a322ddf2bf94a6ee"
server_key_version: "encryptionkey@0"
I20260618 23:19:56.769745 9504 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:19:56.770649 9519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:56.771054 9504 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:56.771183 9504 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "10f7731196154d00b75869c1fa161906"
format_stamp: "Formatted at 2026-06-18 23:19:56 on dist-test-slave-r9ct"
server_key: "c979bce4b193e2aadec16fd850b1cdf2"
server_key_iv: "e8184bd5485da6b7a322ddf2bf94a6ee"
server_key_version: "encryptionkey@0"
I20260618 23:19:56.771275 9504 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:56.786069 9504 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:56.788504 9504 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:56.788669 9504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:56.792878 9504 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:33505
I20260618 23:19:56.792951 9571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:33505 every 8 connection(s)
I20260618 23:19:56.793299 9504 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:19:56.794370 9572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:56.796648 9572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906: Bootstrap starting.
I20260618 23:19:56.797165 9572 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:56.797399 9572 log.cc:824] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:56.798329 9572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906: No bootstrap required, opened a new log
I20260618 23:19:56.800093 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 9504
I20260618 23:19:56.800221 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:19:56.800396 3942 external_mini_cluster.cc:1428] Setting key e35396ce9bb9c880f4eb45f27a9be7d8
I20260618 23:19:56.800637 9572 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10f7731196154d00b75869c1fa161906" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33505 } }
I20260618 23:19:56.800864 9572 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:56.800910 9572 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10f7731196154d00b75869c1fa161906, State: Initialized, Role: FOLLOWER
I20260618 23:19:56.801083 9572 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10f7731196154d00b75869c1fa161906" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33505 } }
I20260618 23:19:56.801192 9572 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:19:56.801231 9572 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:19:56.801291 9572 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:56.802398 9572 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10f7731196154d00b75869c1fa161906" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33505 } }
I20260618 23:19:56.802515 9572 leader_election.cc:302] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10f7731196154d00b75869c1fa161906; no voters:
I20260618 23:19:56.802675 9572 leader_election.cc:288] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:19:56.802774 9577 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:56.802981 9572 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:19:56.802982 9577 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906 [term 1 LEADER]: Becoming Leader. State: Replica: 10f7731196154d00b75869c1fa161906, State: Running, Role: LEADER
I20260618 23:19:56.803191 9577 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10f7731196154d00b75869c1fa161906" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33505 } }
I20260618 23:19:56.803674 9579 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10f7731196154d00b75869c1fa161906. Latest consensus state: current_term: 1 leader_uuid: "10f7731196154d00b75869c1fa161906" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10f7731196154d00b75869c1fa161906" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33505 } } }
I20260618 23:19:56.803776 9579 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906 [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:56.803922 9578 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10f7731196154d00b75869c1fa161906" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10f7731196154d00b75869c1fa161906" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33505 } } }
I20260618 23:19:56.803994 9578 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906 [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:56.804327 9586 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:19:56.805078 9586 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:19:56.806613 9586 catalog_manager.cc:1347] Generated new cluster ID: 9cf77ba3aa624ac3b4ed05dfe930dc4c
I20260618 23:19:56.806658 9586 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 18 23:19:56 dist-test-slave-r9ct krb5kdc[9491](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:56.813392 9576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:56.801008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55768 (local address 127.3.217.190:33505)
0618 23:19:56.801213 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:56.801226 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:56.801321 (+ 95us) server_negotiation.cc:407] Connection header received
0618 23:19:56.801485 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:56.801610 (+ 125us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:56.801691 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:56.801859 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:56.802923 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:56.804763 (+ 1840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:56.805879 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:56.806474 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:56.806573 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:56.809541 (+ 2968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:56.809545 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:56.809545 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:56.809558 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:56.811454 (+ 1896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:56.811836 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:56.811838 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:56.811839 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:56.811984 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:56.812190 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:56.812191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:56.812191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:56.812478 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:56.812630 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:56.813047 (+ 417us) server_negotiation.cc:299] Negotiation successful
0618 23:19:56.813179 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":84,"threads_started":1}
I20260618 23:19:56.822314 9586 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:19:56.822892 9586 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:19:56.830332 9586 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10f7731196154d00b75869c1fa161906: Generated new TSK 0
I20260618 23:19:56.830659 9586 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.217.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
I20260618 23:19:56.862607 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:33505
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:39763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:56.949487 9598 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:56.949746 9598 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:56.949774 9598 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:56.951437 9598 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:56.951514 9598 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:56.951562 9598 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:19:56.953943 9598 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:39763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:33505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9598
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:56.954195 9598 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:56.954434 9598 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:56.959774 9604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:56.959792 9606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:56.959960 9603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:56.960740 9598 server_base.cc:1034] running on GCE node
I20260618 23:19:56.960985 9598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:56.961192 9598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:56.962338 9598 hybrid_clock.cc:648] HybridClock initialized: now 1781824796962326 us; error 25 us; skew 500 ppm
Jun 18 23:19:56 dist-test-slave-r9ct krb5kdc[9491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824796, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:56.964946 9598 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:19:56.965363 9598 webserver.cc:460] Webserver started at http://127.3.217.129:41249/ using document root <none> and password file <none>
I20260618 23:19:56.965811 9598 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:56.965919 9598 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:56.966113 9598 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:56.967507 9598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "0bc0e6a8b4a645d1be906160008a95ec"
format_stamp: "Formatted at 2026-06-18 23:19:56 on dist-test-slave-r9ct"
server_key: "56bda52e5a3e08253f52cd78f22b6cdf"
server_key_iv: "63fad073145398ba8f9b7f8530506667"
server_key_version: "encryptionkey@0"
I20260618 23:19:56.967875 9598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "0bc0e6a8b4a645d1be906160008a95ec"
format_stamp: "Formatted at 2026-06-18 23:19:56 on dist-test-slave-r9ct"
server_key: "56bda52e5a3e08253f52cd78f22b6cdf"
server_key_iv: "63fad073145398ba8f9b7f8530506667"
server_key_version: "encryptionkey@0"
I20260618 23:19:56.969345 9598 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260618 23:19:56.970459 9613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:56.970741 9598 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:56.970851 9598 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "0bc0e6a8b4a645d1be906160008a95ec"
format_stamp: "Formatted at 2026-06-18 23:19:56 on dist-test-slave-r9ct"
server_key: "56bda52e5a3e08253f52cd78f22b6cdf"
server_key_iv: "63fad073145398ba8f9b7f8530506667"
server_key_version: "encryptionkey@0"
I20260618 23:19:56.970983 9598 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:56.988384 9598 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:56.991272 9598 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:56.991451 9598 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:56.991696 9598 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:56.992025 9598 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:56.992079 9598 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:56.992120 9598 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:56.992147 9598 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:56.998067 9598 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:37201
I20260618 23:19:56.998144 9726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:37201 every 8 connection(s)
I20260618 23:19:56.998463 9598 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
Jun 18 23:19:57 dist-test-slave-r9ct krb5kdc[9491](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824796, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:57.008174 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 9598
I20260618 23:19:57.008293 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:19:57.008582 3942 external_mini_cluster.cc:1428] Setting key 7c978f047014220f1578e752d80146f5
I20260618 23:19:57.010109 9576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:56.999803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:56965 (local address 127.3.217.190:33505)
0618 23:19:56.999852 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:56.999854 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:56.999927 (+ 73us) server_negotiation.cc:407] Connection header received
0618 23:19:57.000900 (+ 973us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:57.000902 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:57.000920 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:57.000985 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:57.001754 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:57.002388 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:57.003630 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:57.003988 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:57.004063 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:57.006570 (+ 2507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:57.006571 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:57.006571 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:57.006578 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:57.008385 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:57.009008 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:57.009009 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:57.009010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:57.009062 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:57.009384 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:57.009386 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:57.009386 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:57.009528 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:57.009610 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:57.009902 (+ 292us) server_negotiation.cc:299] Negotiation successful
0618 23:19:57.010002 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260618 23:19:57.010330 9729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:56.999614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33505 (local address 127.3.217.129:56965)
0618 23:19:56.999796 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:56.999851 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:57.000774 (+ 923us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:57.001051 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:57.001055 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:57.001314 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:57.001509 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:57.001512 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:57.002533 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:57.002534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:57.003525 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:57.003527 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:57.004067 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:57.004068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:57.004201 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:57.004733 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:57.004743 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:57.006448 (+ 1705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:57.008482 (+ 2034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:57.008489 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:57.008492 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:57.008827 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:57.009151 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:57.009152 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:57.009152 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:57.009327 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:57.009602 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:57.009608 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:57.009756 (+ 148us) client_negotiation.cc:769] Sending connection context
0618 23:19:57.009879 (+ 123us) client_negotiation.cc:240] Negotiation successful
0618 23:19:57.010056 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":113,"threads_started":1}
I20260618 23:19:57.010810 9727 heartbeater.cc:347] Connected to a master server at 127.3.217.190:33505
I20260618 23:19:57.010937 9727 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:57.011121 9727 heartbeater.cc:511] Master 127.3.217.190:33505 requested a full tablet report, sending...
I20260618 23:19:57.011788 9536 ts_manager.cc:194] Registered new tserver with Master: 0bc0e6a8b4a645d1be906160008a95ec (127.3.217.129:37201)
I20260618 23:19:57.012428 9536 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:56965
WARNING: no policy specified for kudu/127.3.217.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
I20260618 23:19:57.039415 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:33505
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:39763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:57.123082 9732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:57.123275 9732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:57.123298 9732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:57.124459 9732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:57.124505 9732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:57.124531 9732 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:19:57.125988 9732 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:39763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:33505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9732
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:57.126205 9732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:57.126456 9732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:57.131263 9737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:57.131242 9738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:57.131315 9732 server_base.cc:1034] running on GCE node
W20260618 23:19:57.131227 9740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:57.131657 9732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:57.131850 9732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:57.133005 9732 hybrid_clock.cc:648] HybridClock initialized: now 1781824797132963 us; error 55 us; skew 500 ppm
Jun 18 23:19:57 dist-test-slave-r9ct krb5kdc[9491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824797, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:57.135963 9732 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:19:57.136397 9732 webserver.cc:460] Webserver started at http://127.3.217.130:42741/ using document root <none> and password file <none>
I20260618 23:19:57.136616 9732 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:57.136689 9732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:57.136837 9732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:57.137879 9732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "f01ea4f159ea4ad99503627fecccc9b9"
format_stamp: "Formatted at 2026-06-18 23:19:57 on dist-test-slave-r9ct"
server_key: "ce4acd1aff6ce61cd0cb6060a48ded74"
server_key_iv: "0596e908525d9479001dbf23e3519f54"
server_key_version: "encryptionkey@0"
I20260618 23:19:57.138231 9732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "f01ea4f159ea4ad99503627fecccc9b9"
format_stamp: "Formatted at 2026-06-18 23:19:57 on dist-test-slave-r9ct"
server_key: "ce4acd1aff6ce61cd0cb6060a48ded74"
server_key_iv: "0596e908525d9479001dbf23e3519f54"
server_key_version: "encryptionkey@0"
I20260618 23:19:57.139814 9732 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260618 23:19:57.140969 9747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:57.141171 9732 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:19:57.141283 9732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "f01ea4f159ea4ad99503627fecccc9b9"
format_stamp: "Formatted at 2026-06-18 23:19:57 on dist-test-slave-r9ct"
server_key: "ce4acd1aff6ce61cd0cb6060a48ded74"
server_key_iv: "0596e908525d9479001dbf23e3519f54"
server_key_version: "encryptionkey@0"
I20260618 23:19:57.141372 9732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:57.159252 9732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:57.162107 9732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:57.162268 9732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:57.162503 9732 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:57.162801 9732 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:57.162837 9732 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:57.162858 9732 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:57.162870 9732 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:57.168748 9732 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:35005
I20260618 23:19:57.169018 9860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:35005 every 8 connection(s)
I20260618 23:19:57.169188 9732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:19:57.174640 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 9732
I20260618 23:19:57.174829 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:19:57.175158 3942 external_mini_cluster.cc:1428] Setting key e460e730d546cc36fae14a4a8ea7c75e
Jun 18 23:19:57 dist-test-slave-r9ct krb5kdc[9491](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824797, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:57.181120 9576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:57.170441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:52739 (local address 127.3.217.190:33505)
0618 23:19:57.170526 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:57.170528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:57.170687 (+ 159us) server_negotiation.cc:407] Connection header received
0618 23:19:57.171672 (+ 985us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:57.171673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:57.171685 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:57.171752 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:57.172365 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:57.172917 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:57.174258 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:57.174756 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:57.174849 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:57.178133 (+ 3284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:57.178135 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:57.178135 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:57.178146 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:57.179703 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:57.180135 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:57.180137 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:57.180137 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:57.180199 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:57.180446 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:57.180448 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:57.180448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:57.180571 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:57.180644 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:57.180916 (+ 272us) server_negotiation.cc:299] Negotiation successful
0618 23:19:57.181030 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260618 23:19:57.181298 9863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:57.170148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33505 (local address 127.3.217.130:52739)
0618 23:19:57.170512 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:57.170560 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:57.171561 (+ 1001us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:57.171807 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:57.171810 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:57.172056 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:57.172238 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:57.172242 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:57.173063 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:57.173064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:57.174153 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:57.174156 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:57.174882 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:57.174884 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:57.175068 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:57.176027 (+ 959us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:57.176039 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:57.178017 (+ 1978us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:57.179815 (+ 1798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:57.179822 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:57.179824 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:57.180058 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:57.180264 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:57.180266 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:57.180266 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:57.180378 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:57.180637 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:57.180642 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:57.180787 (+ 145us) client_negotiation.cc:769] Sending connection context
0618 23:19:57.180898 (+ 111us) client_negotiation.cc:240] Negotiation successful
0618 23:19:57.181059 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":146,"threads_started":1}
I20260618 23:19:57.181804 9861 heartbeater.cc:347] Connected to a master server at 127.3.217.190:33505
I20260618 23:19:57.181885 9861 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:57.182080 9861 heartbeater.cc:511] Master 127.3.217.190:33505 requested a full tablet report, sending...
I20260618 23:19:57.182487 9536 ts_manager.cc:194] Registered new tserver with Master: f01ea4f159ea4ad99503627fecccc9b9 (127.3.217.130:35005)
I20260618 23:19:57.182927 9536 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:52739
WARNING: no policy specified for kudu/127.3.217.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
I20260618 23:19:57.202520 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:33505
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:39763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:57.282567 9866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:57.282852 9866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:57.282902 9866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:57.284037 9866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:57.284106 9866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:57.284153 9866 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:19:57.285599 9866 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:39763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:33505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9866
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:57.285898 9866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:57.286134 9866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:57.291949 9871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:57.291947 9874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:57.292007 9872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:57.292375 9866 server_base.cc:1034] running on GCE node
I20260618 23:19:57.292701 9866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:57.292982 9866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:57.294173 9866 hybrid_clock.cc:648] HybridClock initialized: now 1781824797294156 us; error 48 us; skew 500 ppm
Jun 18 23:19:57 dist-test-slave-r9ct krb5kdc[9491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824797, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:57.296862 9866 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:19:57.297403 9866 webserver.cc:460] Webserver started at http://127.3.217.131:35657/ using document root <none> and password file <none>
I20260618 23:19:57.297835 9866 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:57.297992 9866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:57.298153 9866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:57.299252 9866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "7a869d0c1aba4d8ea2d76c268d1856df"
format_stamp: "Formatted at 2026-06-18 23:19:57 on dist-test-slave-r9ct"
server_key: "a67bcf6224a5bf38c3f0ae1bf333f292"
server_key_iv: "c1e9b8f1afb82b06e77a8b023a1f9ff5"
server_key_version: "encryptionkey@0"
I20260618 23:19:57.299604 9866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "7a869d0c1aba4d8ea2d76c268d1856df"
format_stamp: "Formatted at 2026-06-18 23:19:57 on dist-test-slave-r9ct"
server_key: "a67bcf6224a5bf38c3f0ae1bf333f292"
server_key_iv: "c1e9b8f1afb82b06e77a8b023a1f9ff5"
server_key_version: "encryptionkey@0"
I20260618 23:19:57.300998 9866 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260618 23:19:57.301944 9881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:57.302152 9866 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:57.302251 9866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "7a869d0c1aba4d8ea2d76c268d1856df"
format_stamp: "Formatted at 2026-06-18 23:19:57 on dist-test-slave-r9ct"
server_key: "a67bcf6224a5bf38c3f0ae1bf333f292"
server_key_iv: "c1e9b8f1afb82b06e77a8b023a1f9ff5"
server_key_version: "encryptionkey@0"
I20260618 23:19:57.302330 9866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:57.317574 9866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:57.320513 9866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:57.320698 9866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:57.321422 9866 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:57.321925 9866 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:57.322005 9866 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:57.322065 9866 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:57.322110 9866 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:57.329241 9866 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:41915
I20260618 23:19:57.329329 9994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:41915 every 8 connection(s)
I20260618 23:19:57.329670 9866 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
Jun 18 23:19:57 dist-test-slave-r9ct krb5kdc[9491](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824797, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:19:57.337731 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 9866
I20260618 23:19:57.337847 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:19:57.338074 3942 external_mini_cluster.cc:1428] Setting key 8c51e5480e8f9512e9da8431d919d8b8
I20260618 23:19:57.341382 9576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:57.330727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:34345 (local address 127.3.217.190:33505)
0618 23:19:57.330768 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:57.330770 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:57.331106 (+ 336us) server_negotiation.cc:407] Connection header received
0618 23:19:57.332155 (+ 1049us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:57.332156 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:57.332171 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:57.332365 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:57.333166 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:57.333735 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:57.334948 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:57.335154 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:57.335227 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:57.337461 (+ 2234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:57.337463 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:57.337463 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:57.337482 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:57.340114 (+ 2632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:57.340595 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:57.340596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:57.340597 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:57.340652 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:57.340865 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:57.340865 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:57.340866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:57.340969 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:57.341027 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:57.341254 (+ 227us) server_negotiation.cc:299] Negotiation successful
0618 23:19:57.341317 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260618 23:19:57.341552 9997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:57.330636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33505 (local address 127.3.217.131:34345)
0618 23:19:57.330909 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:57.330983 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:57.331977 (+ 994us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:57.332475 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:57.332479 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:57.332810 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:57.333043 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:57.333047 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:57.333852 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:57.333854 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:57.334798 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:57.334801 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:57.335260 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:57.335261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:57.335395 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:57.335980 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:57.335988 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:57.337365 (+ 1377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:57.340280 (+ 2915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:57.340286 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:57.340288 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:57.340519 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:57.340716 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:57.340717 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:57.340717 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:57.340810 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:57.341027 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:57.341031 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:57.341142 (+ 111us) client_negotiation.cc:769] Sending connection context
0618 23:19:57.341225 (+ 83us) client_negotiation.cc:240] Negotiation successful
0618 23:19:57.341342 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":207,"threads_started":1}
I20260618 23:19:57.342037 9995 heartbeater.cc:347] Connected to a master server at 127.3.217.190:33505
I20260618 23:19:57.342139 9995 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:57.342327 9995 heartbeater.cc:511] Master 127.3.217.190:33505 requested a full tablet report, sending...
I20260618 23:19:57.342819 9536 ts_manager.cc:194] Registered new tserver with Master: 7a869d0c1aba4d8ea2d76c268d1856df (127.3.217.131:41915)
I20260618 23:19:57.343225 9536 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:34345
I20260618 23:19:57.351613 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/test-admin.keytab.
Jun 18 23:19:57 dist-test-slave-r9ct krb5kdc[9491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:57.372649 3942 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260618 23:19:57.375309 3942 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/krb5cc' of type FILE
W20260618 23:19:57.375299 10002 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:19:57.373917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41824 (local address 127.3.217.129:37201)
0618 23:19:57.374261 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:57.374267 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:57.374282 (+ 15us) server_negotiation.cc:407] Connection header received
0618 23:19:57.374313 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:57.374315 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:57.374332 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:57.374414 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:57.375149 (+ 735us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41824: BlockingRecv error: recv got EOF from 127.0.0.1:41824 (error 108)
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":118,"threads_started":1}
Jun 18 23:19:57 dist-test-slave-r9ct krb5kdc[9491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:57.376432 3942 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Jun 18 23:19:57 dist-test-slave-r9ct krb5kdc[9491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:57.377482 3942 init.cc:295] Successfully reacquired a new kerberos TGT
Jun 18 23:19:57 dist-test-slave-r9ct krb5kdc[9491](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.129@KRBTEST.COM
I20260618 23:19:57.387701 10002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:57.378099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41838 (local address 127.3.217.129:37201)
0618 23:19:57.378155 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:57.378157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:57.378283 (+ 126us) server_negotiation.cc:407] Connection header received
0618 23:19:57.378345 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:57.378346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:57.378358 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:57.378416 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:57.379133 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:57.380032 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:57.380962 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:57.381292 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:57.381406 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:57.384044 (+ 2638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:57.384050 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:57.384051 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:57.384058 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:57.386191 (+ 2133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:57.386572 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:57.386575 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:57.386576 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:57.386638 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:57.387019 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:57.387020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:57.387020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:57.387156 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:57.387298 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:57.387458 (+ 160us) server_negotiation.cc:299] Negotiation successful
0618 23:19:57.387572 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260618 23:19:57.389869 10002 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:19:57.389209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41844 (local address 127.3.217.129:37201)
0618 23:19:57.389250 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:57.389253 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:57.389282 (+ 29us) server_negotiation.cc:407] Connection header received
0618 23:19:57.389360 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:57.389360 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:57.389369 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:57.389418 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:57.389806 (+ 388us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41844: BlockingRecv error: recv got EOF from 127.0.0.1:41844 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260618 23:19:57.389928 3942 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/krb5cc' of type FILE
Jun 18 23:19:57 dist-test-slave-r9ct krb5kdc[9491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:57.390944 3942 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Jun 18 23:19:57 dist-test-slave-r9ct krb5kdc[9491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:57.391750 3942 init.cc:295] Successfully reacquired a new kerberos TGT
Jun 18 23:19:57 dist-test-slave-r9ct krb5kdc[9491](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.129@KRBTEST.COM
I20260618 23:19:57.400048 10002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:57.392397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41854 (local address 127.3.217.129:37201)
0618 23:19:57.392485 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:57.392486 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:57.392494 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:19:57.392594 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:57.392595 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:57.392603 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:57.392654 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:57.392989 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:57.393459 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:57.394239 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:57.394436 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:57.394502 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:57.396954 (+ 2452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:57.396955 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:57.396955 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:57.396961 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:57.398422 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:57.398914 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:57.398915 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:57.398915 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:57.398969 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:57.399319 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:57.399320 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:57.399320 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:57.399583 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:57.399682 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:57.399844 (+ 162us) server_negotiation.cc:299] Negotiation successful
0618 23:19:57.399923 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260618 23:19:57.401757 10002 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:19:57.401263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41864 (local address 127.3.217.129:37201)
0618 23:19:57.401326 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:57.401328 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:57.401345 (+ 17us) server_negotiation.cc:407] Connection header received
0618 23:19:57.401362 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:57.401362 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:57.401369 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:57.401418 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:57.401698 (+ 280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41864: BlockingRecv error: recv got EOF from 127.0.0.1:41864 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260618 23:19:57.401892 3942 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781824769284800-3942-0/krb5kdc/krb5cc' of type FILE
Jun 18 23:19:57 dist-test-slave-r9ct krb5kdc[9491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:57.402964 3942 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Jun 18 23:19:57 dist-test-slave-r9ct krb5kdc[9491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:57.403959 3942 init.cc:295] Successfully reacquired a new kerberos TGT
Jun 18 23:19:57 dist-test-slave-r9ct krb5kdc[9491](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.129@KRBTEST.COM
I20260618 23:19:57.411823 10002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:57.404685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41868 (local address 127.3.217.129:37201)
0618 23:19:57.404782 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:57.404783 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:57.404820 (+ 37us) server_negotiation.cc:407] Connection header received
0618 23:19:57.404888 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:57.404888 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:57.404896 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:57.404945 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:57.405326 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:57.405793 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:57.406608 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:57.406855 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:57.406929 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:57.409210 (+ 2281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:57.409211 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:57.409212 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:57.409218 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:57.410646 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:57.411077 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:57.411078 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:57.411079 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:57.411134 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:57.411326 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:57.411326 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:57.411327 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:57.411424 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:57.411520 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:57.411654 (+ 134us) server_negotiation.cc:299] Negotiation successful
0618 23:19:57.411728 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260618 23:19:57.412827 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 9598
I20260618 23:19:57.417834 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 9732
I20260618 23:19:57.422104 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 9866
I20260618 23:19:57.426321 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 9504
2026-06-18T23:19:57Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (3696 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:19:57 dist-test-slave-r9ct krb5kdc[10015](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:19:57 dist-test-slave-r9ct krb5kdc[10015](info): set up 2 sockets
Jun 18 23:19:57 dist-test-slave-r9ct krb5kdc[10015](info): commencing operation
krb5kdc: starting...
W20260618 23:19:58.483421 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.037s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:19:58 dist-test-slave-r9ct krb5kdc[10015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:19:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:19:58Z Disabled control of system clock
WARNING: no policy specified for oryx/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.190.keytab.
Entry for principal oryx/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.190.keytab.
I20260618 23:19:58.616370 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:43609
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.190.keytab
--principal=oryx/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:33137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:43609
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:58.701566 10028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:58.701771 10028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:58.701793 10028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:58.702860 10028 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:19:58.702898 10028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:58.702912 10028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:58.702931 10028 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:19:58.702943 10028 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:19:58.704288 10028 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:33137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:43609
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.190.keytab
--principal=oryx/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:43609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:58.704470 10028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:58.704628 10028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:58.709498 10033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:58.709805 10036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:58.709906 10028 server_base.cc:1034] running on GCE node
W20260618 23:19:58.710014 10034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:58.710321 10028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:58.710574 10028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:58.711719 10028 hybrid_clock.cc:648] HybridClock initialized: now 1781824798711682 us; error 55 us; skew 500 ppm
Jun 18 23:19:58 dist-test-slave-r9ct krb5kdc[10015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824798, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:58.714613 10028 init.cc:377] Logged in from keytab as oryx/127.3.217.190@KRBTEST.COM (short username oryx)
I20260618 23:19:58.715194 10028 webserver.cc:460] Webserver started at http://127.3.217.190:38395/ using document root <none> and password file <none>
I20260618 23:19:58.715544 10028 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:58.715610 10028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:58.715740 10028 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:58.716952 10028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "326fd11a8ff34d3faad92088c7933f35"
format_stamp: "Formatted at 2026-06-18 23:19:58 on dist-test-slave-r9ct"
server_key: "4ec0b97cd15a8b14914b149a84063f13"
server_key_iv: "04c84b1e32d58dc9d21c62b8e3f24ecb"
server_key_version: "encryptionkey@0"
I20260618 23:19:58.717326 10028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "326fd11a8ff34d3faad92088c7933f35"
format_stamp: "Formatted at 2026-06-18 23:19:58 on dist-test-slave-r9ct"
server_key: "4ec0b97cd15a8b14914b149a84063f13"
server_key_iv: "04c84b1e32d58dc9d21c62b8e3f24ecb"
server_key_version: "encryptionkey@0"
I20260618 23:19:58.719163 10028 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260618 23:19:58.720294 10043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:58.720643 10028 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:58.720774 10028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "326fd11a8ff34d3faad92088c7933f35"
format_stamp: "Formatted at 2026-06-18 23:19:58 on dist-test-slave-r9ct"
server_key: "4ec0b97cd15a8b14914b149a84063f13"
server_key_iv: "04c84b1e32d58dc9d21c62b8e3f24ecb"
server_key_version: "encryptionkey@0"
I20260618 23:19:58.720872 10028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:58.736527 10028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:58.739197 10028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:58.739357 10028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:58.743496 10028 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:43609
I20260618 23:19:58.743533 10095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:43609 every 8 connection(s)
I20260618 23:19:58.743932 10028 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:19:58.744885 10096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:58.747277 10096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35: Bootstrap starting.
I20260618 23:19:58.747869 10096 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:58.748175 10096 log.cc:824] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:58.749179 10096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35: No bootstrap required, opened a new log
I20260618 23:19:58.750865 10096 raft_consensus.cc:348] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } }
I20260618 23:19:58.751008 10096 raft_consensus.cc:374] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:58.751031 10096 raft_consensus.cc:729] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 326fd11a8ff34d3faad92088c7933f35, State: Initialized, Role: FOLLOWER
I20260618 23:19:58.751174 10096 consensus_queue.cc:260] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } }
I20260618 23:19:58.751252 10096 raft_consensus.cc:388] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:19:58.751274 10096 raft_consensus.cc:482] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:19:58.751343 10096 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:58.751859 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 10028
I20260618 23:19:58.752074 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:19:58.752303 3942 external_mini_cluster.cc:1428] Setting key 64ea9356fb70a13ebb613eb0ae2c1539
I20260618 23:19:58.752712 10096 raft_consensus.cc:504] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } }
I20260618 23:19:58.752825 10096 leader_election.cc:302] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 326fd11a8ff34d3faad92088c7933f35; no voters:
I20260618 23:19:58.752992 10096 leader_election.cc:288] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:19:58.753036 10100 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:19:58.753207 10100 raft_consensus.cc:686] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [term 1 LEADER]: Becoming Leader. State: Replica: 326fd11a8ff34d3faad92088c7933f35, State: Running, Role: LEADER
I20260618 23:19:58.753306 10100 consensus_queue.cc:237] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } }
I20260618 23:19:58.753330 10096 sys_catalog.cc:564] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:19:58.754587 10102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 326fd11a8ff34d3faad92088c7933f35. Latest consensus state: current_term: 1 leader_uuid: "326fd11a8ff34d3faad92088c7933f35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } }
I20260618 23:19:58.754664 10102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: This master's current role is: LEADER
I20260618 23:19:58.755234 10103 sys_catalog.cc:455] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "326fd11a8ff34d3faad92088c7933f35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } }
I20260618 23:19:58.755308 10103 sys_catalog.cc:458] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: This master's current role is: LEADER
W20260618 23:19:58.755362 10115 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260618 23:19:58.755419 10115 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260618 23:19:58.755473 10116 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:19:58.755849 10116 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:19:58.758562 10116 catalog_manager.cc:1347] Generated new cluster ID: b57bba0f0abe479a9a26d6963a0faac1
I20260618 23:19:58.758630 10116 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 18 23:19:58 dist-test-slave-r9ct krb5kdc[10015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM
I20260618 23:19:58.764081 10101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:58.752870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59250 (local address 127.3.217.190:43609)
0618 23:19:58.753070 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:58.753080 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:58.753112 (+ 32us) server_negotiation.cc:407] Connection header received
0618 23:19:58.753235 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:58.753242 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:58.753298 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:58.753473 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:58.754327 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:58.756115 (+ 1788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:58.756926 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:58.757341 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:58.757471 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:58.760341 (+ 2870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:58.760345 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:58.760345 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:58.760357 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:58.762034 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:58.762411 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:58.762414 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:58.762414 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:58.762518 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:58.762738 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:58.762739 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:58.762739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:58.763449 (+ 710us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:58.763669 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:58.763746 (+ 77us) server_negotiation.cc:299] Negotiation successful
0618 23:19:58.763891 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":92,"threads_started":1}
I20260618 23:19:58.765488 10116 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:19:58.766185 10116 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:19:58.783551 10116 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35: Generated new TSK 0
I20260618 23:19:58.783807 10116 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.3.217.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.217.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.217.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.129.keytab.
Entry for principal oryx/127.3.217.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.129.keytab.
I20260618 23:19:58.823282 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:43609
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.129.keytab
--principal=oryx/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:33137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:58.915581 10122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:58.915879 10122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:58.915930 10122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:58.917145 10122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:58.917194 10122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:58.917222 10122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:19:58.918627 10122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:33137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.129.keytab
--principal=oryx/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:43609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:58.918884 10122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:58.919075 10122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:58.924265 10128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:58.924412 10127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:58.924437 10130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:58.924784 10122 server_base.cc:1034] running on GCE node
I20260618 23:19:58.925029 10122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:58.925230 10122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:58.926388 10122 hybrid_clock.cc:648] HybridClock initialized: now 1781824798926373 us; error 30 us; skew 500 ppm
Jun 18 23:19:58 dist-test-slave-r9ct krb5kdc[10015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824798, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:58.929404 10122 init.cc:377] Logged in from keytab as oryx/127.3.217.129@KRBTEST.COM (short username oryx)
I20260618 23:19:58.929893 10122 webserver.cc:460] Webserver started at http://127.3.217.129:45791/ using document root <none> and password file <none>
I20260618 23:19:58.930112 10122 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:58.930157 10122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:58.930282 10122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:58.931401 10122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "c0480fa8257f4ff1bf279690478fe255"
format_stamp: "Formatted at 2026-06-18 23:19:58 on dist-test-slave-r9ct"
server_key: "60228a06018e82a9e0c51cf1d26070ef"
server_key_iv: "dd0220e51d66f5146e74dd626bdb809d"
server_key_version: "encryptionkey@0"
I20260618 23:19:58.931773 10122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "c0480fa8257f4ff1bf279690478fe255"
format_stamp: "Formatted at 2026-06-18 23:19:58 on dist-test-slave-r9ct"
server_key: "60228a06018e82a9e0c51cf1d26070ef"
server_key_iv: "dd0220e51d66f5146e74dd626bdb809d"
server_key_version: "encryptionkey@0"
I20260618 23:19:58.933184 10122 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260618 23:19:58.933996 10137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:58.934185 10122 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:58.934283 10122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "c0480fa8257f4ff1bf279690478fe255"
format_stamp: "Formatted at 2026-06-18 23:19:58 on dist-test-slave-r9ct"
server_key: "60228a06018e82a9e0c51cf1d26070ef"
server_key_iv: "dd0220e51d66f5146e74dd626bdb809d"
server_key_version: "encryptionkey@0"
I20260618 23:19:58.934351 10122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:58.973809 10122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:58.976066 10122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:58.976240 10122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:58.976541 10122 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:58.976886 10122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:58.976948 10122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:58.976991 10122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:58.977021 10122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:58.983156 10122 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:36161
I20260618 23:19:58.983309 10250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:36161 every 8 connection(s)
I20260618 23:19:58.983570 10122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:19:58.989459 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 10122
I20260618 23:19:58.989583 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:19:58.989866 3942 external_mini_cluster.cc:1428] Setting key 4a08a02c2ba4a883caef36dbf84a5ac5
Jun 18 23:19:58 dist-test-slave-r9ct krb5kdc[10015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824798, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM
I20260618 23:19:58.994338 10101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:58.984473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:33021 (local address 127.3.217.190:43609)
0618 23:19:58.984519 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:58.984521 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:58.984816 (+ 295us) server_negotiation.cc:407] Connection header received
0618 23:19:58.985259 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:58.985261 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:58.985284 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:58.985346 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:58.986252 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:58.986839 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:58.987802 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:58.987995 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:58.988064 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:58.990835 (+ 2771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:58.990838 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:58.990838 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:58.990850 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:58.992843 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:58.993313 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:58.993315 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:58.993315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:58.993377 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:58.993639 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:58.993640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:58.993640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:58.993751 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:58.993826 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:58.994167 (+ 341us) server_negotiation.cc:299] Negotiation successful
0618 23:19:58.994248 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260618 23:19:58.994540 10253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:58.984446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.3.217.129:33021)
0618 23:19:58.984615 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:58.984656 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:58.985136 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:58.985395 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:58.985398 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:58.985964 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:58.986154 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:58.986158 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:58.986940 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:58.986940 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:58.987722 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:58.987724 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:58.988077 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:58.988077 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:58.988171 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:58.988700 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:58.988713 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:58.990563 (+ 1850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:58.992951 (+ 2388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:58.992956 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:58.992958 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:58.993186 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:58.993464 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:58.993465 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:58.993466 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:58.993571 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:58.993815 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:58.993821 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:58.994022 (+ 201us) client_negotiation.cc:769] Sending connection context
0618 23:19:58.994146 (+ 124us) client_negotiation.cc:240] Negotiation successful
0618 23:19:58.994302 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":100,"threads_started":1}
I20260618 23:19:58.995087 10251 heartbeater.cc:347] Connected to a master server at 127.3.217.190:43609
I20260618 23:19:58.995162 10251 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:58.995345 10251 heartbeater.cc:511] Master 127.3.217.190:43609 requested a full tablet report, sending...
I20260618 23:19:58.995946 10060 ts_manager.cc:194] Registered new tserver with Master: c0480fa8257f4ff1bf279690478fe255 (127.3.217.129:36161)
I20260618 23:19:58.996870 10060 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:33021
WARNING: no policy specified for oryx/127.3.217.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.217.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.217.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.130.keytab.
Entry for principal oryx/127.3.217.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.130.keytab.
I20260618 23:19:59.021791 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:43609
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.130.keytab
--principal=oryx/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:33137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:59.113857 10256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:59.114086 10256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:59.114116 10256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:59.115460 10256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:59.115513 10256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:59.115543 10256 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:19:59.117115 10256 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:33137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.130.keytab
--principal=oryx/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:43609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:59.117367 10256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:59.117640 10256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:59.122855 10261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:59.122957 10264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:59.123116 10256 server_base.cc:1034] running on GCE node
W20260618 23:19:59.122855 10262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:59.123612 10256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:59.123885 10256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:59.125070 10256 hybrid_clock.cc:648] HybridClock initialized: now 1781824799125015 us; error 68 us; skew 500 ppm
Jun 18 23:19:59 dist-test-slave-r9ct krb5kdc[10015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824799, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:59.127758 10256 init.cc:377] Logged in from keytab as oryx/127.3.217.130@KRBTEST.COM (short username oryx)
I20260618 23:19:59.128140 10256 webserver.cc:460] Webserver started at http://127.3.217.130:38345/ using document root <none> and password file <none>
I20260618 23:19:59.128376 10256 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:59.128428 10256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:59.128553 10256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:59.129562 10256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "c776636e83564073b0724de19b9693ed"
format_stamp: "Formatted at 2026-06-18 23:19:59 on dist-test-slave-r9ct"
server_key: "51a1e20950c2dc488f4910898b792374"
server_key_iv: "d2f69967317e0dedbabaf627fccdd4e3"
server_key_version: "encryptionkey@0"
I20260618 23:19:59.129917 10256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "c776636e83564073b0724de19b9693ed"
format_stamp: "Formatted at 2026-06-18 23:19:59 on dist-test-slave-r9ct"
server_key: "51a1e20950c2dc488f4910898b792374"
server_key_iv: "d2f69967317e0dedbabaf627fccdd4e3"
server_key_version: "encryptionkey@0"
I20260618 23:19:59.131542 10256 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260618 23:19:59.132584 10271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:59.132802 10256 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:19:59.132898 10256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "c776636e83564073b0724de19b9693ed"
format_stamp: "Formatted at 2026-06-18 23:19:59 on dist-test-slave-r9ct"
server_key: "51a1e20950c2dc488f4910898b792374"
server_key_iv: "d2f69967317e0dedbabaf627fccdd4e3"
server_key_version: "encryptionkey@0"
I20260618 23:19:59.132990 10256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:59.145618 10256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:59.148104 10256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:59.148272 10256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:59.148519 10256 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:59.148842 10256 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:59.148897 10256 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:59.148947 10256 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:59.148979 10256 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:59.155426 10256 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:37279
I20260618 23:19:59.155591 10384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:37279 every 8 connection(s)
I20260618 23:19:59.155783 10256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:19:59.157778 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 10256
I20260618 23:19:59.157889 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:19:59.158118 3942 external_mini_cluster.cc:1428] Setting key 7b8bc8237ae8f662a5633aa3a153095e
Jun 18 23:19:59 dist-test-slave-r9ct krb5kdc[10015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824799, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM
I20260618 23:19:59.167644 10101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.156773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:46727 (local address 127.3.217.190:43609)
0618 23:19:59.156871 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:59.156874 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:59.157341 (+ 467us) server_negotiation.cc:407] Connection header received
0618 23:19:59.157998 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:59.158001 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:59.158014 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:59.158086 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:59.159501 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.160160 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.161262 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.161567 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.161636 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.164382 (+ 2746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:59.164384 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:59.164384 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:59.164393 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:59.165828 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.166388 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.166389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.166390 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.166448 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.166822 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.166824 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.166824 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.166999 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:59.167097 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:59.167497 (+ 400us) server_negotiation.cc:299] Negotiation successful
0618 23:19:59.167577 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
WARNING: no policy specified for oryx/127.3.217.131@KRBTEST.COM; defaulting to no policy
I20260618 23:19:59.167884 10387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.156860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.3.217.130:46727)
0618 23:19:59.157180 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:59.157219 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:59.157837 (+ 618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:59.158176 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:59.158181 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:59.159058 (+ 877us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:59.159334 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.159340 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.160307 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.160308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.161148 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.161150 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.161683 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.161684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.161791 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.162343 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:59.162351 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:59.164269 (+ 1918us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:59.165956 (+ 1687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.165963 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.165965 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.166287 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.166528 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.166529 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.166529 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.166666 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.167116 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:59.167123 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:59.167302 (+ 179us) client_negotiation.cc:769] Sending connection context
0618 23:19:59.167440 (+ 138us) client_negotiation.cc:240] Negotiation successful
0618 23:19:59.167610 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":132,"threads_started":1}
I20260618 23:19:59.168577 10385 heartbeater.cc:347] Connected to a master server at 127.3.217.190:43609
I20260618 23:19:59.168862 10385 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:59.169116 10385 heartbeater.cc:511] Master 127.3.217.190:43609 requested a full tablet report, sending...
I20260618 23:19:59.169701 10060 ts_manager.cc:194] Registered new tserver with Master: c776636e83564073b0724de19b9693ed (127.3.217.130:37279)
I20260618 23:19:59.170250 10060 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:46727
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.217.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.217.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.131.keytab.
Entry for principal oryx/127.3.217.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.131.keytab.
I20260618 23:19:59.191745 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:43609
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.131.keytab
--principal=oryx/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:33137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:59.300045 10390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:59.300473 10390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:59.300500 10390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:59.302274 10390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:59.302328 10390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:59.302357 10390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:19:59.304016 10390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:33137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.131.keytab
--principal=oryx/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:43609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:59.304349 10390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:59.304739 10390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:59.311076 10396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:59.311123 10398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:59.311087 10395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:59.311401 10390 server_base.cc:1034] running on GCE node
I20260618 23:19:59.311668 10390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:59.311937 10390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:59.313124 10390 hybrid_clock.cc:648] HybridClock initialized: now 1781824799313108 us; error 32 us; skew 500 ppm
Jun 18 23:19:59 dist-test-slave-r9ct krb5kdc[10015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824799, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:59.316576 10390 init.cc:377] Logged in from keytab as oryx/127.3.217.131@KRBTEST.COM (short username oryx)
I20260618 23:19:59.317134 10390 webserver.cc:460] Webserver started at http://127.3.217.131:38345/ using document root <none> and password file <none>
I20260618 23:19:59.317373 10390 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:59.317447 10390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:59.317601 10390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:59.318686 10390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "6d46d42947fe4b01b677d1188e0cf4c1"
format_stamp: "Formatted at 2026-06-18 23:19:59 on dist-test-slave-r9ct"
server_key: "6cad227622867c7638476656b875d93f"
server_key_iv: "2bf9ca1a21dcd7d509db28f096a2885a"
server_key_version: "encryptionkey@0"
I20260618 23:19:59.319159 10390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "6d46d42947fe4b01b677d1188e0cf4c1"
format_stamp: "Formatted at 2026-06-18 23:19:59 on dist-test-slave-r9ct"
server_key: "6cad227622867c7638476656b875d93f"
server_key_iv: "2bf9ca1a21dcd7d509db28f096a2885a"
server_key_version: "encryptionkey@0"
I20260618 23:19:59.320514 10390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:59.321475 10405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:59.321857 10390 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:59.322101 10390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "6d46d42947fe4b01b677d1188e0cf4c1"
format_stamp: "Formatted at 2026-06-18 23:19:59 on dist-test-slave-r9ct"
server_key: "6cad227622867c7638476656b875d93f"
server_key_iv: "2bf9ca1a21dcd7d509db28f096a2885a"
server_key_version: "encryptionkey@0"
I20260618 23:19:59.322204 10390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:59.351197 10390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:59.353480 10390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:59.353657 10390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:59.353892 10390 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:19:59.354231 10390 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:19:59.354291 10390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:59.354338 10390 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:19:59.354359 10390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:59.361524 10390 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:36449
I20260618 23:19:59.361667 10518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:36449 every 8 connection(s)
I20260618 23:19:59.361963 10390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:19:59.368570 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 10390
I20260618 23:19:59.368697 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:19:59.369079 3942 external_mini_cluster.cc:1428] Setting key 4687085c08ac565c126d4c7c925ff315
Jun 18 23:19:59 dist-test-slave-r9ct krb5kdc[10015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824799, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM
I20260618 23:19:59.374603 10101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.362869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:32843 (local address 127.3.217.190:43609)
0618 23:19:59.362932 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:59.362935 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:59.363089 (+ 154us) server_negotiation.cc:407] Connection header received
0618 23:19:59.363542 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:59.363543 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:59.363555 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:59.363625 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:59.365185 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.365699 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.366922 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.367174 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.367378 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.371346 (+ 3968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:59.371348 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:59.371348 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:59.371358 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:59.372821 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.373452 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.373453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.373453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.373509 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.373952 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.373953 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.373953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.374086 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:59.374147 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:59.374467 (+ 320us) server_negotiation.cc:299] Negotiation successful
0618 23:19:59.374536 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260618 23:19:59.374825 10521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.362661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.3.217.131:32843)
0618 23:19:59.362903 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:59.362946 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:59.363409 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:59.363733 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:59.363737 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:59.364849 (+ 1112us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:59.365053 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.365057 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.365838 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.365839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.366652 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.366654 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.367425 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.367426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.367589 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.368487 (+ 898us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:59.368499 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:59.371009 (+ 2510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:59.373078 (+ 2069us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.373084 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.373086 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.373322 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.373722 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.373723 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.373723 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.373829 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.374175 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:59.374180 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:59.374309 (+ 129us) client_negotiation.cc:769] Sending connection context
0618 23:19:59.374395 (+ 86us) client_negotiation.cc:240] Negotiation successful
0618 23:19:59.374551 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":169,"threads_started":1}
I20260618 23:19:59.375864 10519 heartbeater.cc:347] Connected to a master server at 127.3.217.190:43609
I20260618 23:19:59.376010 10519 heartbeater.cc:464] Registering TS with master...
I20260618 23:19:59.376195 10519 heartbeater.cc:511] Master 127.3.217.190:43609 requested a full tablet report, sending...
I20260618 23:19:59.376649 10060 ts_manager.cc:194] Registered new tserver with Master: 6d46d42947fe4b01b677d1188e0cf4c1 (127.3.217.131:36449)
I20260618 23:19:59.377178 10060 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:32843
I20260618 23:19:59.382432 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.3.217.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.217.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.217.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.189.keytab.
Entry for principal oryx/127.3.217.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.189.keytab.
I20260618 23:19:59.415218 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.189:32829
--webserver_interface=127.3.217.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.189.keytab
--principal=oryx/127.3.217.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:33137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:43609,127.3.217.189:32829
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:59.505944 10524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:59.506253 10524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:59.506295 10524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:59.507750 10524 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:19:59.507831 10524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:59.507859 10524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:59.507872 10524 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:19:59.507884 10524 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:19:59.510145 10524 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:33137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:43609,127.3.217.189:32829
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.189.keytab
--principal=oryx/127.3.217.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.189:32829
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.3.217.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
W20260618 23:19:59.510479 10524 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.3.217.190:43609,127.3.217.189:32829'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260618 23:19:59.510843 10524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:59.511159 10524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:59.516048 10532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:59.516161 10529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:59.516207 10530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:59.516562 10524 server_base.cc:1034] running on GCE node
I20260618 23:19:59.516804 10524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:59.517091 10524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:59.518241 10524 hybrid_clock.cc:648] HybridClock initialized: now 1781824799518208 us; error 60 us; skew 500 ppm
Jun 18 23:19:59 dist-test-slave-r9ct krb5kdc[10015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824799, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:59.520903 10524 init.cc:377] Logged in from keytab as oryx/127.3.217.189@KRBTEST.COM (short username oryx)
I20260618 23:19:59.521341 10524 webserver.cc:460] Webserver started at http://127.3.217.189:46517/ using document root <none> and password file <none>
I20260618 23:19:59.521600 10524 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:59.521672 10524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:59.521819 10524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:59.522966 10524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/data/instance:
uuid: "8efdf00c53584d2bb4375e7c4ff02b96"
format_stamp: "Formatted at 2026-06-18 23:19:59 on dist-test-slave-r9ct"
server_key: "6aa7c399ad9259e1603d59c534709a3a"
server_key_iv: "bd85e66005e9673083a203a0836e3b91"
server_key_version: "encryptionkey@0"
I20260618 23:19:59.523324 10524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/wal/instance:
uuid: "8efdf00c53584d2bb4375e7c4ff02b96"
format_stamp: "Formatted at 2026-06-18 23:19:59 on dist-test-slave-r9ct"
server_key: "6aa7c399ad9259e1603d59c534709a3a"
server_key_iv: "bd85e66005e9673083a203a0836e3b91"
server_key_version: "encryptionkey@0"
I20260618 23:19:59.524837 10524 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:59.525676 10539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:59.526160 10524 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:59.526345 10524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/wal
uuid: "8efdf00c53584d2bb4375e7c4ff02b96"
format_stamp: "Formatted at 2026-06-18 23:19:59 on dist-test-slave-r9ct"
server_key: "6aa7c399ad9259e1603d59c534709a3a"
server_key_iv: "bd85e66005e9673083a203a0836e3b91"
server_key_version: "encryptionkey@0"
I20260618 23:19:59.526464 10524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:59.538664 10524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:59.541147 10524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:59.541339 10524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:59.545578 10524 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.189:32829
I20260618 23:19:59.545624 10591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.189:32829 every 8 connection(s)
I20260618 23:19:59.545974 10524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/data/info.pb
I20260618 23:19:59.547407 10592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:59.549799 10592 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:19:59.550879 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 10524
Jun 18 23:19:59 dist-test-slave-r9ct krb5kdc[10015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824799, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.189@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM
Jun 18 23:19:59 dist-test-slave-r9ct krb5kdc[10015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.3.217.189@KRBTEST.COM
I20260618 23:19:59.560639 10101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.550875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59252 (local address 127.3.217.190:43609)
0618 23:19:59.551078 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:59.551081 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:59.551333 (+ 252us) server_negotiation.cc:407] Connection header received
0618 23:19:59.552129 (+ 796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:59.552130 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:59.552142 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:59.552217 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:59.552715 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.553256 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.554348 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.554649 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.554749 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.556980 (+ 2231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:59.556982 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:59.556982 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:59.556991 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:59.559046 (+ 2055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.559657 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.559659 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.559659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.559722 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.559978 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.559979 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.559979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.560128 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:59.560210 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:59.560472 (+ 262us) server_negotiation.cc:299] Negotiation successful
0618 23:19:59.560548 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260618 23:19:59.560827 10594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.550892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.0.0.1:59252)
0618 23:19:59.551177 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:59.551221 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:59.551969 (+ 748us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:59.552247 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:59.552249 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:59.552488 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:59.552628 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.552632 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.553356 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.553358 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.554276 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.554278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.554766 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.554767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.554908 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.555492 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:59.555499 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:59.556838 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:59.559251 (+ 2413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.559258 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.559260 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.559563 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.559792 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.559793 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.559793 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.559907 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.560201 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:59.560206 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:59.560338 (+ 132us) client_negotiation.cc:769] Sending connection context
0618 23:19:59.560452 (+ 114us) client_negotiation.cc:240] Negotiation successful
0618 23:19:59.560600 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":200,"threads_started":1}
I20260618 23:19:59.561290 10596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.551581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51880 (local address 127.3.217.189:32829)
0618 23:19:59.551728 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:59.551732 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:59.551768 (+ 36us) server_negotiation.cc:407] Connection header received
0618 23:19:59.551971 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:59.551979 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:59.552004 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:59.552094 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:59.552750 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.553834 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.554804 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.555246 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.555333 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.557808 (+ 2475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:59.557813 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:59.557814 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:59.557820 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:59.559656 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.560067 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.560070 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.560070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.560128 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.560330 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.560331 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.560332 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.560469 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:59.560615 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:59.561110 (+ 495us) server_negotiation.cc:299] Negotiation successful
0618 23:19:59.561188 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":84,"threads_started":1}
I20260618 23:19:59.561529 10592 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } has no permanent_uuid. Determining permanent_uuid...
Jun 18 23:19:59 dist-test-slave-r9ct krb5kdc[10015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824799, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.189@KRBTEST.COM for oryx/127.3.217.189@KRBTEST.COM
I20260618 23:19:59.568929 10594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.562037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:32829 (local address 127.0.0.1:51892)
0618 23:19:59.562080 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:59.562093 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:59.562144 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:59.562288 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:59.562289 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:59.562440 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:59.562469 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.562470 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.563254 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.563255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.563754 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.563755 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.564185 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.564185 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.564250 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.564681 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:59.564687 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:59.565933 (+ 1246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:59.567691 (+ 1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.567692 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.567692 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.567871 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.568189 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.568190 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.568190 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.568250 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.568519 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:59.568520 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:59.568559 (+ 39us) client_negotiation.cc:769] Sending connection context
0618 23:19:59.568656 (+ 97us) client_negotiation.cc:240] Negotiation successful
0618 23:19:59.568755 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260618 23:19:59.568975 10596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.562098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51892 (local address 127.3.217.189:32829)
0618 23:19:59.562142 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:59.562144 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:59.562153 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:19:59.562212 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:59.562213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:59.562224 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:59.562283 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:59.562560 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.563149 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.563854 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.564096 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.564184 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.566035 (+ 1851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:59.566036 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:59.566037 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:59.566043 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:59.567585 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.567960 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.567961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.567962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.568112 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.568328 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.568329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.568329 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.568448 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:59.568527 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:59.568679 (+ 152us) server_negotiation.cc:299] Negotiation successful
0618 23:19:59.568808 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":65,"server-negotiator.queue_time_us":27}
I20260618 23:19:59.570596 10592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96: Bootstrap starting.
I20260618 23:19:59.571488 10592 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:59.571898 10592 log.cc:824] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:59.572723 10592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96: No bootstrap required, opened a new log
I20260618 23:19:59.574158 10592 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } }
I20260618 23:19:59.574303 10592 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:59.574348 10592 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8efdf00c53584d2bb4375e7c4ff02b96, State: Initialized, Role: FOLLOWER
I20260618 23:19:59.574469 10592 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } }
I20260618 23:19:59.574836 10592 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:19:59.574807 10598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } } }
I20260618 23:19:59.575001 10598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [sys.catalog]: This master's current role is: FOLLOWER
W20260618 23:19:59.576995 10609 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260618 23:19:59.577073 10609 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260618 23:19:59.578843 10524 master_runner.cc:428] Detected that this master 8efdf00c53584d2bb4375e7c4ff02b96 is joining an existing cluster
I20260618 23:19:59.578886 10524 master_runner.cc:432] Initiating AddMaster RPC to add 127.3.217.189:32829
I20260618 23:19:59.588209 10101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.580128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59254 (local address 127.3.217.190:43609)
0618 23:19:59.580180 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:59.580182 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:59.580190 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:19:59.580213 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:59.580214 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:59.580225 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:59.580304 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:59.580652 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.581421 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.582330 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.582630 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.582703 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.584586 (+ 1883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:59.584589 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:59.584589 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:59.584600 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:59.586633 (+ 2033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.587241 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.587242 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.587243 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.587314 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.587542 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.587542 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.587543 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.587654 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:59.587729 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:59.588031 (+ 302us) server_negotiation.cc:299] Negotiation successful
0618 23:19:59.588116 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260618 23:19:59.588227 10615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.579927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.0.0.1:59254)
0618 23:19:59.580064 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:59.580076 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:59.580128 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:59.580313 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:59.580314 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:59.580464 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:59.580568 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.580570 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.581533 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.581534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.582242 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.582245 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.582769 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.582770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.582827 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.583594 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:59.583600 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:59.584402 (+ 802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:59.586896 (+ 2494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.586898 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.586898 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.587149 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.587395 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.587396 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.587396 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.587471 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.587729 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:59.587729 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:59.587861 (+ 132us) client_negotiation.cc:769] Sending connection context
0618 23:19:59.587999 (+ 138us) client_negotiation.cc:240] Negotiation successful
0618 23:19:59.588115 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":84,"threads_started":1}
I20260618 23:19:59.593433 10616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.579952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:32829 (local address 127.0.0.1:51900)
0618 23:19:59.585318 (+ 5366us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:59.585328 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:59.585425 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:59.585573 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:59.585574 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:59.585860 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:59.585947 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.585949 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.587032 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.587033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.588121 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.588126 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.588933 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.588933 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.588991 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.589431 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:59.589436 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:59.589903 (+ 467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:59.592231 (+ 2328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.592232 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.592232 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.592462 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.592658 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.592658 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.592659 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.592704 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.593047 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:59.593048 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:59.593109 (+ 61us) client_negotiation.cc:769] Sending connection context
0618 23:19:59.593185 (+ 76us) client_negotiation.cc:240] Negotiation successful
0618 23:19:59.593300 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5349,"thread_start_us":69,"threads_started":1}
I20260618 23:19:59.593504 10596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.580498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51900 (local address 127.3.217.189:32829)
0618 23:19:59.580563 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:59.580565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:59.585418 (+ 4853us) server_negotiation.cc:407] Connection header received
0618 23:19:59.585482 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:59.585483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:59.585492 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:59.585570 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:59.586048 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.586906 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.588544 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.588806 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.588852 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.590151 (+ 1299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:59.590153 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:59.590153 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:59.590162 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:59.592109 (+ 1947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.592552 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.592553 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.592553 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.592600 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.592758 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.592758 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.592758 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.592861 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:59.593014 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:59.593231 (+ 217us) server_negotiation.cc:299] Negotiation successful
0618 23:19:59.593365 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":45}
Jun 18 23:19:59 dist-test-slave-r9ct krb5kdc[10015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824798, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.190@KRBTEST.COM for oryx/127.3.217.189@KRBTEST.COM
I20260618 23:19:59.598789 10618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.591205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51906 (local address 127.3.217.189:32829)
0618 23:19:59.591336 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:59.591338 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:59.591579 (+ 241us) server_negotiation.cc:407] Connection header received
0618 23:19:59.591675 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:59.591676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:59.591697 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:59.591769 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:59.592361 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.592854 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.593823 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.594066 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.594124 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.596126 (+ 2002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:59.596127 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:59.596128 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:59.596134 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:59.597547 (+ 1413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.597950 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.597952 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.597952 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.598009 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.598207 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.598208 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.598208 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.598331 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:59.598408 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:59.598581 (+ 173us) server_negotiation.cc:299] Negotiation successful
0618 23:19:59.598660 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":72,"threads_started":1}
I20260618 23:19:59.598778 10617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.591047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:32829 (local address 127.0.0.1:51906)
0618 23:19:59.591452 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:59.591497 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:59.591583 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:59.591792 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:59.591796 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:59.592186 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:59.592244 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.592246 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.592936 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.592937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.593736 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.593738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.594176 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.594177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.594251 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.594748 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:59.594753 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:59.596036 (+ 1283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:59.597651 (+ 1615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.597658 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.597661 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.597865 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.598077 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.598078 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.598078 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.598135 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.598400 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:59.598406 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:59.598457 (+ 51us) client_negotiation.cc:769] Sending connection context
0618 23:19:59.598557 (+ 100us) client_negotiation.cc:240] Negotiation successful
0618 23:19:59.598662 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":72,"threads_started":1}
I20260618 23:19:59.599543 10060 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.3.217.189:32829: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96"
member_type: NON_VOTER
last_known_addr {
host: "127.3.217.189"
port: 32829
}
attrs {
promote: true
}
}
dest_uuid: "326fd11a8ff34d3faad92088c7933f35"
cas_config_opid_index: -1
I20260618 23:19:59.599875 10060 consensus_queue.cc:237] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true } }
I20260618 23:19:59.600394 10620 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 8efdf00c53584d2bb4375e7c4ff02b96 (127.3.217.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true } } }
I20260618 23:19:59.600777 10566 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:19:59.601675 10620 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.3.217.189:32829
I20260618 23:19:59.601831 10566 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [term 1 FOLLOWER]: Refusing update from remote peer 326fd11a8ff34d3faad92088c7933f35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260618 23:19:59.602115 10524 master.cc:537] Master@127.3.217.189:32829 shutting down...
I20260618 23:19:59.603179 10621 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:19:59.603472 10619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "326fd11a8ff34d3faad92088c7933f35" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true } } }
I20260618 23:19:59.603556 10619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: This master's current role is: LEADER
W20260618 23:19:59.605489 10046 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260618 23:19:59.606046 10046 consensus_peers.cc:487] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 -> Peer 8efdf00c53584d2bb4375e7c4ff02b96 (127.3.217.189:32829): Couldn't send request to peer 8efdf00c53584d2bb4375e7c4ff02b96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260618 23:19:59.606598 10524 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:19:59.606761 10524 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:19:59.606833 10524 tablet_replica.cc:330] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96: stopping tablet replica
I20260618 23:19:59.620378 10524 master.cc:552] Master@127.3.217.189:32829 shutdown complete.
I20260618 23:19:59.620433 10524 master_runner.cc:305] Clearing existing system tablet
I20260618 23:19:59.620574 10524 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:59.620623 10524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:59.621265 10524 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260618 23:19:59.621737 10625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:59.621857 10524 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:59.621914 10524 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:59.621937 10524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/wal
uuid: "8efdf00c53584d2bb4375e7c4ff02b96"
format_stamp: "Formatted at 2026-06-18 23:19:59 on dist-test-slave-r9ct"
server_key: "6aa7c399ad9259e1603d59c534709a3a"
server_key_iv: "bd85e66005e9673083a203a0836e3b91"
server_key_version: "encryptionkey@0"
I20260618 23:19:59.622584 10524 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:19:59.624282 10524 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260618 23:19:59.624342 10524 log.cc:1196] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260618 23:19:59.624581 10524 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96: Deleting consensus metadata
I20260618 23:19:59.624711 10524 master_runner.cc:315] Copying system tablet from 127.3.217.190:43609
I20260618 23:19:59.625396 10524 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96: tablet copy: Beginning tablet copy session from remote peer at address 127.3.217.190:43609
I20260618 23:19:59.633349 10631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.625721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.0.0.1:59270)
0618 23:19:59.625955 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:59.625966 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:59.626029 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:59.626169 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:59.626170 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:59.626434 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:59.626497 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.626499 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.627456 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.627456 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.628024 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.628026 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.628648 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.628649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.628788 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.629454 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:59.629459 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:59.629822 (+ 363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:59.631846 (+ 2024us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.631847 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.631847 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.632049 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.632552 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.632553 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.632553 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.632632 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.632980 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:59.632981 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:59.633025 (+ 44us) client_negotiation.cc:769] Sending connection context
0618 23:19:59.633117 (+ 92us) client_negotiation.cc:240] Negotiation successful
0618 23:19:59.633236 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":95,"threads_started":1}
I20260618 23:19:59.633415 10101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.625829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59270 (local address 127.3.217.190:43609)
0618 23:19:59.625896 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:59.625898 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:59.626031 (+ 133us) server_negotiation.cc:407] Connection header received
0618 23:19:59.626082 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:59.626083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:59.626094 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:59.626167 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:59.626579 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.627353 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.628111 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.628509 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.628592 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.629949 (+ 1357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:59.629950 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:59.629950 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:59.629966 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:59.631734 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.632134 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.632135 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.632135 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.632190 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.632710 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.632711 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.632711 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.632842 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:59.632927 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:59.633218 (+ 291us) server_negotiation.cc:299] Negotiation successful
0618 23:19:59.633331 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260618 23:19:59.634159 10080 tablet_copy_service.cc:140] P 326fd11a8ff34d3faad92088c7933f35: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 8efdf00c53584d2bb4375e7c4ff02b96 ({username='oryx', principal='oryx/127.3.217.189@KRBTEST.COM'} at 127.0.0.1:59270)
I20260618 23:19:59.634258 10080 tablet_copy_service.cc:161] P 326fd11a8ff34d3faad92088c7933f35: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 8efdf00c53584d2bb4375e7c4ff02b96 at {username='oryx', principal='oryx/127.3.217.189@KRBTEST.COM'} at 127.0.0.1:59270: session id = 8efdf00c53584d2bb4375e7c4ff02b96-00000000000000000000000000000000
I20260618 23:19:59.635351 10080 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35: Tablet Copy: opened 0 blocks and 1 log segments
I20260618 23:19:59.636361 10524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260618 23:19:59.638039 10524 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96: tablet copy: Starting download of 0 data blocks...
I20260618 23:19:59.638240 10524 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96: tablet copy: Starting download of 1 WAL segments...
I20260618 23:19:59.639413 10524 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260618 23:19:59.640561 10080 tablet_copy_service.cc:342] P 326fd11a8ff34d3faad92088c7933f35: Request end of tablet copy session 8efdf00c53584d2bb4375e7c4ff02b96-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.3.217.189@KRBTEST.COM'} at 127.0.0.1:59270
I20260618 23:19:59.640621 10080 tablet_copy_service.cc:433] P 326fd11a8ff34d3faad92088c7933f35: ending tablet copy session 8efdf00c53584d2bb4375e7c4ff02b96-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 8efdf00c53584d2bb4375e7c4ff02b96
I20260618 23:19:59.643973 10524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:59.645377 10633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:59.645854 10524 server_base.cc:1034] running on GCE node
W20260618 23:19:59.646189 10635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:59.646670 10632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:59.646946 10524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:59.647333 10524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:59.648514 10524 hybrid_clock.cc:648] HybridClock initialized: now 1781824799648502 us; error 31 us; skew 500 ppm
Jun 18 23:19:59 dist-test-slave-r9ct krb5kdc[10015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824799, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:59.649987 10524 init.cc:377] Logged in from keytab as oryx/127.3.217.189@KRBTEST.COM (short username oryx)
I20260618 23:19:59.650274 10524 webserver.cc:460] Webserver started at http://127.3.217.189:38817/ using document root <none> and password file <none>
I20260618 23:19:59.650411 10524 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:59.650458 10524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:59.651425 10524 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:19:59.652129 10642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:59.652403 10524 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:19:59.652474 10524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/wal
uuid: "8efdf00c53584d2bb4375e7c4ff02b96"
format_stamp: "Formatted at 2026-06-18 23:19:59 on dist-test-slave-r9ct"
server_key: "6aa7c399ad9259e1603d59c534709a3a"
server_key_iv: "bd85e66005e9673083a203a0836e3b91"
server_key_version: "encryptionkey@0"
I20260618 23:19:59.652534 10524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:59.659551 10524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:59.661248 10524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:59.664409 10524 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.189:32829
I20260618 23:19:59.664849 10524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-1/data/info.pb
I20260618 23:19:59.664849 10694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.189:32829 every 8 connection(s)
I20260618 23:19:59.665653 10695 sys_catalog.cc:263] Verifying existing consensus state
I20260618 23:19:59.666069 10695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96: Bootstrap starting.
I20260618 23:19:59.669415 10695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260618 23:19:59.669642 10695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96: Bootstrap complete.
I20260618 23:19:59.669855 10695 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true } }
I20260618 23:19:59.669946 10695 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8efdf00c53584d2bb4375e7c4ff02b96, State: Initialized, Role: LEARNER
I20260618 23:19:59.669981 10695 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true } }
I20260618 23:19:59.670192 10695 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:19:59.670287 10698 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true } } }
I20260618 23:19:59.670452 10698 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [sys.catalog]: This master's current role is: LEARNER
I20260618 23:19:59.671733 10709 catalog_manager.cc:1259] Loaded cluster ID: b57bba0f0abe479a9a26d6963a0faac1
I20260618 23:19:59.671784 10709 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96: loading cluster ID for follower catalog manager: success
I20260618 23:19:59.672943 10709 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96: acquiring CA information for follower catalog manager: success
I20260618 23:19:59.673239 10709 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260618 23:19:59.721199 10710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.713698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51934 (local address 127.3.217.189:32829)
0618 23:19:59.713854 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:59.713861 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:59.713868 (+ 7us) server_negotiation.cc:407] Connection header received
0618 23:19:59.713889 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:59.713890 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:59.713899 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:59.713969 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:59.714506 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.715259 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.716103 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.716345 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.716424 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.717719 (+ 1295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:59.717720 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:59.717720 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:59.717727 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:59.719828 (+ 2101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.720381 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.720382 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.720383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.720452 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.720644 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.720645 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.720646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.720758 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:59.720890 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:59.720969 (+ 79us) server_negotiation.cc:299] Negotiation successful
0618 23:19:59.721053 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":75,"threads_started":1}
WARNING: no policy specified for oryx/127.3.217.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.217.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.217.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.188.keytab.
Entry for principal oryx/127.3.217.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.188.keytab.
I20260618 23:19:59.762019 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.188:35337
--webserver_interface=127.3.217.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.188.keytab
--principal=oryx/127.3.217.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:33137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:43609,127.3.217.189:32829,127.3.217.188:35337
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:19:59.852938 10713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:19:59.853159 10713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:19:59.853196 10713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:19:59.854481 10713 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:19:59.854548 10713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:19:59.854574 10713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:19:59.854600 10713 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:19:59.854625 10713 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:19:59.856113 10713 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:33137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:43609,127.3.217.189:32829,127.3.217.188:35337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.188.keytab
--principal=oryx/127.3.217.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.188:35337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.3.217.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:19:59.856385 10713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:19:59.856608 10713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:19:59.861744 10721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:59.861709 10719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:19:59.861701 10718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:19:59.862052 10713 server_base.cc:1034] running on GCE node
I20260618 23:19:59.862601 10713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:19:59.863161 10713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:19:59.864362 10713 hybrid_clock.cc:648] HybridClock initialized: now 1781824799864328 us; error 57 us; skew 500 ppm
Jun 18 23:19:59 dist-test-slave-r9ct krb5kdc[10015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824799, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:19:59.867336 10713 init.cc:377] Logged in from keytab as oryx/127.3.217.188@KRBTEST.COM (short username oryx)
I20260618 23:19:59.867827 10713 webserver.cc:460] Webserver started at http://127.3.217.188:42209/ using document root <none> and password file <none>
I20260618 23:19:59.868088 10713 fs_manager.cc:359] Metadata directory not provided
I20260618 23:19:59.868165 10713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:19:59.868325 10713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:19:59.869990 10713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/data/instance:
uuid: "2541f54725c047a18cfa07b2a6968a0a"
format_stamp: "Formatted at 2026-06-18 23:19:59 on dist-test-slave-r9ct"
server_key: "e149caa49d46a406b1f98b333d16a626"
server_key_iv: "8bd6de7fd6e0a6c0c136c677f6a551c9"
server_key_version: "encryptionkey@0"
I20260618 23:19:59.870448 10713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/wal/instance:
uuid: "2541f54725c047a18cfa07b2a6968a0a"
format_stamp: "Formatted at 2026-06-18 23:19:59 on dist-test-slave-r9ct"
server_key: "e149caa49d46a406b1f98b333d16a626"
server_key_iv: "8bd6de7fd6e0a6c0c136c677f6a551c9"
server_key_version: "encryptionkey@0"
I20260618 23:19:59.872227 10713 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:59.873191 10728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:19:59.873612 10713 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:19:59.873822 10713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/wal
uuid: "2541f54725c047a18cfa07b2a6968a0a"
format_stamp: "Formatted at 2026-06-18 23:19:59 on dist-test-slave-r9ct"
server_key: "e149caa49d46a406b1f98b333d16a626"
server_key_iv: "8bd6de7fd6e0a6c0c136c677f6a551c9"
server_key_version: "encryptionkey@0"
I20260618 23:19:59.873957 10713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:19:59.902983 10713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:19:59.905578 10713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:19:59.905788 10713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:19:59.912282 10713 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.188:35337
I20260618 23:19:59.912380 10780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.188:35337 every 8 connection(s)
I20260618 23:19:59.912812 10713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/data/info.pb
I20260618 23:19:59.914026 10781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:19:59.915709 10781 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:19:59.918161 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 10713
Jun 18 23:19:59 dist-test-slave-r9ct krb5kdc[10015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824799, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.188@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM
Jun 18 23:19:59 dist-test-slave-r9ct krb5kdc[10015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.3.217.188@KRBTEST.COM
I20260618 23:19:59.927201 10101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.917178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59282 (local address 127.3.217.190:43609)
0618 23:19:59.917241 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:59.917243 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:59.917299 (+ 56us) server_negotiation.cc:407] Connection header received
0618 23:19:59.917811 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:59.917812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:59.917821 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:59.917890 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:59.918881 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.919958 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.921000 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.921199 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.921283 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.923821 (+ 2538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:59.923822 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:59.923823 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:59.923830 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:59.925524 (+ 1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.925945 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.925946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.925947 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.926058 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.926464 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.926465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.926466 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.926598 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:59.926673 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:59.926987 (+ 314us) server_negotiation.cc:299] Negotiation successful
0618 23:19:59.927111 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260618 23:19:59.927536 10784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.918759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38060 (local address 127.3.217.188:35337)
0618 23:19:59.918925 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:59.918937 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:59.918957 (+ 20us) server_negotiation.cc:407] Connection header received
0618 23:19:59.918974 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:59.918976 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:59.918991 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:59.919049 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:59.919925 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.920802 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.921564 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.921945 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.922012 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.924577 (+ 2565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:59.924583 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:59.924584 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:59.924591 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:59.926232 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.926572 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.926575 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.926575 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.926628 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.926856 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.926858 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.926858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.926999 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:59.927172 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:59.927222 (+ 50us) server_negotiation.cc:299] Negotiation successful
0618 23:19:59.927354 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":139,"thread_start_us":108,"threads_started":1}
I20260618 23:19:59.927630 10783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.916988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.0.0.1:59282)
0618 23:19:59.917186 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:59.917228 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:59.917661 (+ 433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:59.918095 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:59.918099 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:59.918479 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:59.918769 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.918775 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.920153 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.920154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.920894 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.920897 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.921311 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.921313 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.921453 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.921979 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:59.921989 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:59.923701 (+ 1712us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:59.925617 (+ 1916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.925627 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.925629 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.925862 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.926142 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.926143 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.926144 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.926380 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.926676 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:59.926683 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:59.926851 (+ 168us) client_negotiation.cc:769] Sending connection context
0618 23:19:59.926963 (+ 112us) client_negotiation.cc:240] Negotiation successful
0618 23:19:59.927120 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":18,"thread_start_us":127,"threads_started":1}
I20260618 23:19:59.928094 10781 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } has no permanent_uuid. Determining permanent_uuid...
Jun 18 23:19:59 dist-test-slave-r9ct krb5kdc[10015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824799, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.188@KRBTEST.COM for oryx/127.3.217.189@KRBTEST.COM
I20260618 23:19:59.934669 10783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.928355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:32829 (local address 127.0.0.1:51948)
0618 23:19:59.928415 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:59.928425 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:59.928458 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:59.928587 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:59.928587 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:59.928692 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:59.928735 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.928736 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.929390 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.929391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.929903 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.929904 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.930267 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.930267 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.930324 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.930641 (+ 317us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:59.930645 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:59.931800 (+ 1155us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:59.933717 (+ 1917us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.933718 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.933718 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.933885 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.934123 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.934124 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.934125 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.934193 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.934440 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:59.934441 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:59.934478 (+ 37us) client_negotiation.cc:769] Sending connection context
0618 23:19:59.934532 (+ 54us) client_negotiation.cc:240] Negotiation successful
0618 23:19:59.934606 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260618 23:19:59.934677 10710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.928423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51948 (local address 127.3.217.189:32829)
0618 23:19:59.928491 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:59.928493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:59.928499 (+ 6us) server_negotiation.cc:407] Connection header received
0618 23:19:59.928528 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:59.928529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:59.928540 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:59.928586 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:59.928792 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.929268 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.930005 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.930196 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.930260 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.931881 (+ 1621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:59.931882 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:59.931887 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:59.931892 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:59.933629 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.933987 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.933988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.933988 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.934038 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.934258 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.934259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.934259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.934356 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:59.934406 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:59.934556 (+ 150us) server_negotiation.cc:299] Negotiation successful
0618 23:19:59.934619 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260618 23:19:59.935185 10781 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } has no permanent_uuid. Determining permanent_uuid...
Jun 18 23:19:59 dist-test-slave-r9ct krb5kdc[10015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824799, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.188@KRBTEST.COM for oryx/127.3.217.188@KRBTEST.COM
I20260618 23:19:59.941967 10783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.935450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35337 (local address 127.0.0.1:38062)
0618 23:19:59.935499 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:59.935510 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:59.935646 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:59.935866 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:59.935867 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:59.936039 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:59.936077 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.936078 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.936721 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.936722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.937367 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.937369 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.937701 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.937701 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.937736 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.938200 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:59.938204 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:59.939320 (+ 1116us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:59.940971 (+ 1651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.940972 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.940972 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.941137 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.941343 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.941344 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.941344 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.941402 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.941664 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:59.941665 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:59.941700 (+ 35us) client_negotiation.cc:769] Sending connection context
0618 23:19:59.941766 (+ 66us) client_negotiation.cc:240] Negotiation successful
0618 23:19:59.941857 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260618 23:19:59.942021 10784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.935513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38062 (local address 127.3.217.188:35337)
0618 23:19:59.935565 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:59.935567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:59.935575 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:19:59.935757 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:59.935758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:59.935769 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:59.935825 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:59.936183 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.936654 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.937446 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.937637 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.937694 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.939423 (+ 1729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:59.939424 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:59.939424 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:59.939430 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:59.940810 (+ 1380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.941222 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.941223 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.941223 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.941271 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.941472 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.941473 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.941474 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.941584 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:59.941670 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:59.941794 (+ 124us) server_negotiation.cc:299] Negotiation successful
0618 23:19:59.941910 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":35}
I20260618 23:19:59.943449 10781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a: Bootstrap starting.
I20260618 23:19:59.944298 10781 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a: Neither blocks nor log segments found. Creating new log.
I20260618 23:19:59.944666 10781 log.cc:824] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a: Log is configured to *not* fsync() on all Append() calls
I20260618 23:19:59.945727 10781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a: No bootstrap required, opened a new log
I20260618 23:19:59.947695 10781 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } }
I20260618 23:19:59.947820 10781 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:19:59.947842 10781 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2541f54725c047a18cfa07b2a6968a0a, State: Initialized, Role: FOLLOWER
I20260618 23:19:59.947983 10781 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } }
I20260618 23:19:59.948326 10781 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:19:59.948309 10786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } } }
I20260618 23:19:59.948469 10786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [sys.catalog]: This master's current role is: FOLLOWER
W20260618 23:19:59.950090 10797 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260618 23:19:59.950146 10797 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260618 23:19:59.953895 10713 master_runner.cc:428] Detected that this master 2541f54725c047a18cfa07b2a6968a0a is joining an existing cluster
I20260618 23:19:59.953949 10713 master_runner.cc:432] Initiating AddMaster RPC to add 127.3.217.188:35337
I20260618 23:19:59.961973 10710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.955547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51950 (local address 127.3.217.189:32829)
0618 23:19:59.955656 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:59.955658 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:59.956129 (+ 471us) server_negotiation.cc:407] Connection header received
0618 23:19:59.956175 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:59.956176 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:59.956187 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:59.956253 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:59.956643 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.957353 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.958207 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.958425 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.958511 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.959514 (+ 1003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:59.959515 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:59.959516 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:59.959522 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:59.960836 (+ 1314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.961201 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.961202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.961203 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.961253 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.961477 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.961479 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.961479 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.961587 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:59.961660 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:59.961803 (+ 143us) server_negotiation.cc:299] Negotiation successful
0618 23:19:59.961877 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260618 23:19:59.962009 10805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.955612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:32829 (local address 127.0.0.1:51950)
0618 23:19:59.956058 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:59.956070 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:59.956122 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:59.956259 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:59.956260 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:59.956448 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:59.956558 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.956560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.957430 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.957431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.958095 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.958098 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.958523 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.958524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.958583 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.959094 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:59.959099 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:59.959410 (+ 311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:59.960930 (+ 1520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.960931 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.960931 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.961117 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.961341 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.961342 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.961342 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.961415 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.961653 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:59.961653 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:59.961695 (+ 42us) client_negotiation.cc:769] Sending connection context
0618 23:19:59.961782 (+ 87us) client_negotiation.cc:240] Negotiation successful
0618 23:19:59.961877 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":67,"threads_started":1}
I20260618 23:19:59.967479 10805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.955792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35337 (local address 127.0.0.1:38068)
0618 23:19:59.962070 (+ 6278us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:59.962080 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:59.962141 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:59.962272 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:59.962273 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:59.962412 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:59.962458 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.962459 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.963168 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.963169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.963671 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.963672 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.964035 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.964036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.964093 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.964489 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:59.964493 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:59.964725 (+ 232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:59.966479 (+ 1754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.966480 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.966480 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.966645 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.966852 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.966853 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.966853 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.966918 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.967162 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:59.967163 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:59.967198 (+ 35us) client_negotiation.cc:769] Sending connection context
0618 23:19:59.967266 (+ 68us) client_negotiation.cc:240] Negotiation successful
0618 23:19:59.967358 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6268,"thread_start_us":77,"threads_started":1}
I20260618 23:19:59.967487 10784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.955741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38068 (local address 127.3.217.188:35337)
0618 23:19:59.955847 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:59.955849 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:59.962120 (+ 6271us) server_negotiation.cc:407] Connection header received
0618 23:19:59.962197 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:59.962198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:59.962206 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:59.962229 (+ 23us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:59.962556 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.963076 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.963762 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.963955 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.964035 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.964823 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:59.964824 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:59.964825 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:59.964830 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:59.966368 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.966743 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.966744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.966744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.966795 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.966968 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.966969 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.966970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.967094 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:59.967171 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:59.967296 (+ 125us) server_negotiation.cc:299] Negotiation successful
0618 23:19:59.967406 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":88}
I20260618 23:19:59.979360 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 10122
I20260618 23:19:59.983659 10101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.955557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59288 (local address 127.3.217.190:43609)
0618 23:19:59.955608 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:59.955610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:59.955824 (+ 214us) server_negotiation.cc:407] Connection header received
0618 23:19:59.955912 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:59.955913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:59.955924 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:59.955989 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:59.956410 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.957150 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.958229 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.958540 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.958584 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.980382 (+ 21798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:59.980384 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:59.980385 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:59.980394 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:59.982235 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.982762 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.982764 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.982764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.982827 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.983093 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.983093 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.983094 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.983243 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:59.983284 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:59.983485 (+ 201us) server_negotiation.cc:299] Negotiation successful
0618 23:19:59.983565 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260618 23:19:59.983676 10804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.955519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.0.0.1:59288)
0618 23:19:59.955734 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:59.955745 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:59.955833 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:59.955986 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:59.955987 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:59.956256 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:59.956326 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.956328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.957237 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.957238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.958125 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.958127 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.958661 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.958662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.958757 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.979732 (+ 20975us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:59.979738 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:59.980264 (+ 526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:59.982341 (+ 2077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.982342 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.982343 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.982526 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.982946 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.982947 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.982948 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.983016 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.983333 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:59.983333 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:59.983377 (+ 44us) client_negotiation.cc:769] Sending connection context
0618 23:19:59.983458 (+ 81us) client_negotiation.cc:240] Negotiation successful
0618 23:19:59.983567 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":154,"threads_started":1}
I20260618 23:19:59.986104 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:36161
--local_ip_for_outbound_sockets=127.3.217.129
--tserver_master_addrs=127.3.217.190:43609
--webserver_port=45791
--webserver_interface=127.3.217.129
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.129.keytab
--principal=oryx/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:33137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.3.217.190:43609,127.3.217.189:32829
--tserver_master_addrs=127.3.217.190:43609,127.3.217.189:32829,127.3.217.188:35337 with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 18 23:19:59 dist-test-slave-r9ct krb5kdc[10015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824798, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.190@KRBTEST.COM for oryx/127.3.217.188@KRBTEST.COM
I20260618 23:19:59.996935 10784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.988489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38072 (local address 127.3.217.188:35337)
0618 23:19:59.988522 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0618 23:19:59.988524 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:19:59.988533 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:19:59.988576 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:19:59.988577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:19:59.988586 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:19:59.988631 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:19:59.988909 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.989366 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.990121 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.990318 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.990416 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.993991 (+ 3575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:19:59.993994 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:19:59.993994 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:19:59.994004 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:19:59.995774 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.996162 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.996163 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.996164 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.996220 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:19:59.996426 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:19:59.996427 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:19:59.996427 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:19:59.996536 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:19:59.996613 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0618 23:19:59.996765 (+ 152us) server_negotiation.cc:299] Negotiation successful
0618 23:19:59.996840 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260618 23:19:59.996946 10617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:19:59.988415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35337 (local address 127.0.0.1:38072)
0618 23:19:59.988463 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0618 23:19:59.988475 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:19:59.988514 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:19:59.988633 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:19:59.988634 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:19:59.988795 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:19:59.988833 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.988835 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.989473 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.989474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.990037 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:19:59.990039 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:19:59.990410 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:19:59.990411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:19:59.990938 (+ 527us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:19:59.991600 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:19:59.991605 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:19:59.993089 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:19:59.995897 (+ 2808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.995898 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.995898 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.996072 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.996297 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:19:59.996298 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:19:59.996298 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:19:59.996361 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:19:59.996605 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:19:59.996606 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:19:59.996652 (+ 46us) client_negotiation.cc:769] Sending connection context
0618 23:19:59.996743 (+ 91us) client_negotiation.cc:240] Negotiation successful
0618 23:19:59.996845 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260618 23:19:59.997767 10060 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.3.217.188:35337: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a"
member_type: NON_VOTER
last_known_addr {
host: "127.3.217.188"
port: 35337
}
attrs {
promote: true
}
}
dest_uuid: "326fd11a8ff34d3faad92088c7933f35"
cas_config_opid_index: 5
I20260618 23:19:59.998246 10060 consensus_queue.cc:237] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: NON_VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: true } }
I20260618 23:19:59.998767 10621 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 2541f54725c047a18cfa07b2a6968a0a (127.3.217.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: NON_VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: true } } }
I20260618 23:19:59.999200 10755 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:00.000504 10621 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.3.217.188:35337
I20260618 23:20:00.000576 10755 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 1 FOLLOWER]: Refusing update from remote peer 326fd11a8ff34d3faad92088c7933f35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260618 23:20:00.000581 10621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "326fd11a8ff34d3faad92088c7933f35" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: NON_VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: true } } }
I20260618 23:20:00.000656 10621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: This master's current role is: LEADER
I20260618 23:20:00.000926 10619 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: NON_VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:20:00.001454 10713 master.cc:537] Master@127.3.217.188:35337 shutting down...
I20260618 23:20:00.004384 10755 raft_consensus.cc:858] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: NON_VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: true } }
W20260618 23:20:00.004478 10755 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: NON_VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: true } }
I20260618 23:20:00.005105 10755 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 8efdf00c53584d2bb4375e7c4ff02b96 (127.3.217.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true } } }
I20260618 23:20:00.006492 10809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "326fd11a8ff34d3faad92088c7933f35" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true } } }
I20260618 23:20:00.006669 10809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260618 23:20:00.006551 10786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 326fd11a8ff34d3faad92088c7933f35. Latest consensus state: current_term: 1 leader_uuid: "326fd11a8ff34d3faad92088c7933f35" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true } } }
I20260618 23:20:00.006875 10786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260618 23:20:00.006217 10813 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "326fd11a8ff34d3faad92088c7933f35" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true } } }
I20260618 23:20:00.007181 10813 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260618 23:20:00.009505 10617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.001013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:32829 (local address 127.0.0.1:51956)
0618 23:20:00.001209 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:00.001221 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:00.001260 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:00.006310 (+ 5050us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:00.006313 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:00.006315 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:00.006377 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.006380 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.007456 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.007457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.008263 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.008265 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.009190 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.009191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.009264 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.009279 (+ 15us) client_negotiation.cc:769] Sending connection context
0618 23:20:00.009337 (+ 58us) client_negotiation.cc:240] Negotiation successful
0618 23:20:00.009398 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178}
I20260618 23:20:00.009791 10713 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260618 23:20:00.009909 10713 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260618 23:20:00.009953 10713 tablet_replica.cc:330] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a: stopping tablet replica
I20260618 23:20:00.009407 10619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "326fd11a8ff34d3faad92088c7933f35" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: NON_VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: true } } }
I20260618 23:20:00.010020 10619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: This master's current role is: LEADER
W20260618 23:20:00.010308 10047 consensus_peers.cc:487] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 -> Peer 2541f54725c047a18cfa07b2a6968a0a (127.3.217.188:35337): Couldn't send request to peer 2541f54725c047a18cfa07b2a6968a0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260618 23:20:00.010326 10710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.001168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51956 (local address 127.3.217.189:32829)
0618 23:20:00.001486 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.001489 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.001498 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:20:00.001524 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.001525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.001550 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.001627 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:00.006509 (+ 4882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.007364 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.008370 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.009008 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.009085 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.009153 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.010195 (+ 1042us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.010245 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293}
I20260618 23:20:00.010558 10669 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [term 1 LEARNER]: Refusing update from remote peer 326fd11a8ff34d3faad92088c7933f35: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260618 23:20:00.011068 10619 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260618 23:20:00.011623 10669 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 2541f54725c047a18cfa07b2a6968a0a (127.3.217.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: NON_VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: true } } }
I20260618 23:20:00.013227 10698 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 326fd11a8ff34d3faad92088c7933f35. Latest consensus state: current_term: 1 leader_uuid: "326fd11a8ff34d3faad92088c7933f35" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: NON_VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: true } } }
I20260618 23:20:00.013329 10698 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [sys.catalog]: This master's current role is: LEARNER
I20260618 23:20:00.013374 10698 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "326fd11a8ff34d3faad92088c7933f35" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: NON_VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: true } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: NON_VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: true } } }
I20260618 23:20:00.013424 10698 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [sys.catalog]: This master's current role is: LEARNER
I20260618 23:20:00.014074 10621 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35: attempting to promote NON_VOTER 8efdf00c53584d2bb4375e7c4ff02b96 to VOTER
I20260618 23:20:00.014277 10621 consensus_queue.cc:237] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: NON_VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: true } }
I20260618 23:20:00.014871 10617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.014698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35337 (local address 127.0.0.1:38084)
0618 23:20:00.014788 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:00.014832 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:35337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260618 23:20:00.014935 10669 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [term 1 LEARNER]: Refusing update from remote peer 326fd11a8ff34d3faad92088c7933f35: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260618 23:20:00.015151 10620 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260618 23:20:00.015484 10617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.015339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35337 (local address 127.0.0.1:38086)
0618 23:20:00.015422 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:00.015452 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:35337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260618 23:20:00.015676 10047 consensus_peers.cc:487] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 -> Peer 2541f54725c047a18cfa07b2a6968a0a (127.3.217.188:35337): Couldn't send request to peer 2541f54725c047a18cfa07b2a6968a0a. Status: Network error: Client connection negotiation failed: client connection to 127.3.217.188:35337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260618 23:20:00.015903 10620 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 8efdf00c53584d2bb4375e7c4ff02b96 (127.3.217.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: NON_VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: true } } }
I20260618 23:20:00.016050 10669 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 8efdf00c53584d2bb4375e7c4ff02b96 (127.3.217.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: NON_VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: true } } }
I20260618 23:20:00.016891 10620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "326fd11a8ff34d3faad92088c7933f35" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: NON_VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: true } } }
I20260618 23:20:00.016979 10620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: This master's current role is: LEADER
I20260618 23:20:00.017071 10620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "326fd11a8ff34d3faad92088c7933f35" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: NON_VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: true } } }
I20260618 23:20:00.017128 10620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: This master's current role is: LEADER
I20260618 23:20:00.017102 10815 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "326fd11a8ff34d3faad92088c7933f35" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: NON_VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: true } } }
I20260618 23:20:00.017186 10815 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [sys.catalog]: This master's current role is: FOLLOWER
I20260618 23:20:00.024880 10713 master.cc:552] Master@127.3.217.188:35337 shutdown complete.
I20260618 23:20:00.024947 10713 master_runner.cc:305] Clearing existing system tablet
I20260618 23:20:00.025084 10713 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:00.025146 10713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:00.025878 10713 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.002s
I20260618 23:20:00.026364 10818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:00.026497 10713 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:00.026687 10713 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:20:00.026760 10713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/wal
uuid: "2541f54725c047a18cfa07b2a6968a0a"
format_stamp: "Formatted at 2026-06-18 23:19:59 on dist-test-slave-r9ct"
server_key: "e149caa49d46a406b1f98b333d16a626"
server_key_iv: "8bd6de7fd6e0a6c0c136c677f6a551c9"
server_key_version: "encryptionkey@0"
I20260618 23:20:00.027304 10713 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:20:00.028612 10713 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260618 23:20:00.028694 10713 log.cc:1196] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260618 23:20:00.028910 10713 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a: Deleting consensus metadata
I20260618 23:20:00.029099 10713 master_runner.cc:315] Copying system tablet from 127.3.217.190:43609
I20260618 23:20:00.029701 10713 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a: tablet copy: Beginning tablet copy session from remote peer at address 127.3.217.190:43609
I20260618 23:20:00.036475 10101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.030036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59294 (local address 127.3.217.190:43609)
0618 23:20:00.030080 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.030082 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.030185 (+ 103us) server_negotiation.cc:407] Connection header received
0618 23:20:00.030244 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.030245 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.030255 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.030314 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:00.030649 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.031338 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.032062 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.032266 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.032347 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.033572 (+ 1225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:00.033574 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:00.033574 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:00.033582 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:00.035219 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.035691 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.035692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.035692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.035756 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.035954 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.035954 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.035955 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.036070 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:00.036144 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.036304 (+ 160us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.036381 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260618 23:20:00.036489 10824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.030001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.0.0.1:59294)
0618 23:20:00.030111 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:00.030121 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:00.030180 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:00.030319 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:00.030320 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:00.030510 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:00.030560 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.030562 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.031434 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.031435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.031970 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.031972 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.032348 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.032349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.032414 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.033016 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:00.033021 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:00.033419 (+ 398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:00.035352 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:00.035353 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:00.035354 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:00.035606 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:00.035821 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:00.035822 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:00.035823 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:00.035880 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:00.036136 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:00.036137 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:00.036181 (+ 44us) client_negotiation.cc:769] Sending connection context
0618 23:20:00.036274 (+ 93us) client_negotiation.cc:240] Negotiation successful
0618 23:20:00.036380 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":61,"threads_started":1}
I20260618 23:20:00.037113 10080 tablet_copy_service.cc:140] P 326fd11a8ff34d3faad92088c7933f35: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 2541f54725c047a18cfa07b2a6968a0a ({username='oryx', principal='oryx/127.3.217.188@KRBTEST.COM'} at 127.0.0.1:59294)
I20260618 23:20:00.037191 10080 tablet_copy_service.cc:161] P 326fd11a8ff34d3faad92088c7933f35: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 2541f54725c047a18cfa07b2a6968a0a at {username='oryx', principal='oryx/127.3.217.188@KRBTEST.COM'} at 127.0.0.1:59294: session id = 2541f54725c047a18cfa07b2a6968a0a-00000000000000000000000000000000
I20260618 23:20:00.037664 10080 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35: Tablet Copy: opened 0 blocks and 1 log segments
I20260618 23:20:00.038116 10713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260618 23:20:00.039173 10713 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a: tablet copy: Starting download of 0 data blocks...
I20260618 23:20:00.039327 10713 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a: tablet copy: Starting download of 1 WAL segments...
I20260618 23:20:00.039978 10713 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260618 23:20:00.040714 10080 tablet_copy_service.cc:342] P 326fd11a8ff34d3faad92088c7933f35: Request end of tablet copy session 2541f54725c047a18cfa07b2a6968a0a-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.3.217.188@KRBTEST.COM'} at 127.0.0.1:59294
I20260618 23:20:00.040773 10080 tablet_copy_service.cc:433] P 326fd11a8ff34d3faad92088c7933f35: ending tablet copy session 2541f54725c047a18cfa07b2a6968a0a-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 2541f54725c047a18cfa07b2a6968a0a
I20260618 23:20:00.043210 10713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:00.044786 10826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:00.047978 10825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:00.052112 10713 server_base.cc:1034] running on GCE node
W20260618 23:20:00.052374 10828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:00.052523 10713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:00.052703 10713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:00.053818 10713 hybrid_clock.cc:648] HybridClock initialized: now 1781824800053810 us; error 26 us; skew 500 ppm
Jun 18 23:20:00 dist-test-slave-r9ct krb5kdc[10015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824800, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:20:00.055399 10713 init.cc:377] Logged in from keytab as oryx/127.3.217.188@KRBTEST.COM (short username oryx)
I20260618 23:20:00.055683 10713 webserver.cc:460] Webserver started at http://127.3.217.188:45753/ using document root <none> and password file <none>
I20260618 23:20:00.055801 10713 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:00.055840 10713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:00.056473 10713 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260618 23:20:00.056991 10835 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:00.057127 10713 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260618 23:20:00.057174 10713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/wal
uuid: "2541f54725c047a18cfa07b2a6968a0a"
format_stamp: "Formatted at 2026-06-18 23:19:59 on dist-test-slave-r9ct"
server_key: "e149caa49d46a406b1f98b333d16a626"
server_key_iv: "8bd6de7fd6e0a6c0c136c677f6a551c9"
server_key_version: "encryptionkey@0"
I20260618 23:20:00.057236 10713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:00.067798 10713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:00.069509 10713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:00.072806 10713 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.188:35337
I20260618 23:20:00.073146 10713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/master-2/data/info.pb
I20260618 23:20:00.073947 10888 sys_catalog.cc:263] Verifying existing consensus state
I20260618 23:20:00.074390 10888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a: Bootstrap starting.
I20260618 23:20:00.074821 10887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.188:35337 every 8 connection(s)
I20260618 23:20:00.076639 10888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260618 23:20:00.077050 10888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a: Bootstrap complete.
I20260618 23:20:00.077329 10888 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: NON_VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: true } }
I20260618 23:20:00.077440 10888 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2541f54725c047a18cfa07b2a6968a0a, State: Initialized, Role: LEARNER
I20260618 23:20:00.077497 10888 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: NON_VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: true } }
I20260618 23:20:00.077744 10891 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: NON_VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: true } } }
I20260618 23:20:00.077811 10888 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:20:00.077900 10891 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [sys.catalog]: This master's current role is: LEARNER
I20260618 23:20:00.079636 10902 catalog_manager.cc:1259] Loaded cluster ID: b57bba0f0abe479a9a26d6963a0faac1
I20260618 23:20:00.079757 10902 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a: loading cluster ID for follower catalog manager: success
I20260618 23:20:00.081264 10902 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a: acquiring CA information for follower catalog manager: success
I20260618 23:20:00.082037 10902 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260618 23:20:00.111865 10806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:00.112171 10806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:00.112210 10806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:00.113850 10806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:00.113915 10806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:00.113955 10806 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:20:00.116103 10806 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:33137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.129.keytab
--principal=oryx/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:36161
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=45791
--tserver_master_addrs=127.3.217.190:43609,127.3.217.189:32829,127.3.217.188:35337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10806
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:00.116357 10806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:00.116616 10806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:00.123001 10910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:00.123113 10908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:00.123092 10907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:00.123780 10806 server_base.cc:1034] running on GCE node
I20260618 23:20:00.124019 10806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:00.124284 10806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:00.125460 10806 hybrid_clock.cc:648] HybridClock initialized: now 1781824800125471 us; error 53 us; skew 500 ppm
Jun 18 23:20:00 dist-test-slave-r9ct krb5kdc[10015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824800, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:20:00.128463 10806 init.cc:377] Logged in from keytab as oryx/127.3.217.129@KRBTEST.COM (short username oryx)
I20260618 23:20:00.128892 10806 webserver.cc:460] Webserver started at http://127.3.217.129:45791/ using document root <none> and password file <none>
I20260618 23:20:00.129110 10806 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:00.129189 10806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:00.130626 10806 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:00.131278 10917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:00.131577 10806 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260618 23:20:00.131853 10806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "c0480fa8257f4ff1bf279690478fe255"
format_stamp: "Formatted at 2026-06-18 23:19:58 on dist-test-slave-r9ct"
server_key: "60228a06018e82a9e0c51cf1d26070ef"
server_key_iv: "dd0220e51d66f5146e74dd626bdb809d"
server_key_version: "encryptionkey@0"
I20260618 23:20:00.132354 10806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:00.150297 10806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:00.152866 10806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:00.153046 10806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:00.153368 10806 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:20:00.153743 10806 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:20:00.153784 10806 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:00.153807 10806 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:20:00.153820 10806 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:00.161546 10806 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:36161
I20260618 23:20:00.161670 11030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:36161 every 8 connection(s)
I20260618 23:20:00.161934 10806 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:20:00.163431 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 10806
I20260618 23:20:00.163594 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 10256
I20260618 23:20:00.170535 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:37279
--local_ip_for_outbound_sockets=127.3.217.130
--tserver_master_addrs=127.3.217.190:43609
--webserver_port=38345
--webserver_interface=127.3.217.130
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.130.keytab
--principal=oryx/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:33137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.3.217.190:43609,127.3.217.189:32829
--tserver_master_addrs=127.3.217.190:43609,127.3.217.189:32829,127.3.217.188:35337 with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 18 23:20:00 dist-test-slave-r9ct krb5kdc[10015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824800, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.189@KRBTEST.COM
Jun 18 23:20:00 dist-test-slave-r9ct krb5kdc[10015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824800, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM
Jun 18 23:20:00 dist-test-slave-r9ct krb5kdc[10015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824800, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.188@KRBTEST.COM
I20260618 23:20:00.175333 10710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.162765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:37397 (local address 127.3.217.189:32829)
0618 23:20:00.162807 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.162809 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.163213 (+ 404us) server_negotiation.cc:407] Connection header received
0618 23:20:00.164090 (+ 877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.164092 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.164103 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.164166 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:00.165563 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.166408 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.168058 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.168396 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.168456 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.171464 (+ 3008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:00.171466 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:00.171467 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:00.171474 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:00.173369 (+ 1895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.173867 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.173868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.173869 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.174060 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.174407 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.174409 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.174409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.174622 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:00.174677 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.175100 (+ 423us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.175193 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260618 23:20:00.175735 11035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.162703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:32829 (local address 127.3.217.129:37397)
0618 23:20:00.163133 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:00.163143 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:00.163639 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:00.164247 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:00.164251 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:00.165170 (+ 919us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:00.165468 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.165473 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.166536 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.166537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.167962 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.167965 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.168534 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.168535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.168625 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.169333 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:00.169344 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:00.171375 (+ 2031us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:00.173458 (+ 2083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:00.173465 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:00.173467 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:00.173782 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:00.174162 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:00.174163 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:00.174163 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:00.174301 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:00.174711 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:00.174718 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:00.174915 (+ 197us) client_negotiation.cc:769] Sending connection context
0618 23:20:00.175024 (+ 109us) client_negotiation.cc:240] Negotiation successful
0618 23:20:00.175223 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"mutex_wait_us":108,"thread_start_us":237,"threads_started":1}
I20260618 23:20:00.176013 10101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.162750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:52243 (local address 127.3.217.190:43609)
0618 23:20:00.162803 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.162805 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.163235 (+ 430us) server_negotiation.cc:407] Connection header received
0618 23:20:00.164812 (+ 1577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.164813 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.164824 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.164854 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:00.165719 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.166457 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.168054 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.168345 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.168386 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.172637 (+ 4251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:00.172639 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:00.172639 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:00.172647 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:00.174477 (+ 1830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.175199 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.175200 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.175200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.175255 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.175470 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.175471 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.175471 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.175588 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:00.175637 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.175840 (+ 203us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.175924 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260618 23:20:00.176329 11036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.162689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.3.217.129:52243)
0618 23:20:00.163080 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:00.163125 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:00.163635 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:00.165182 (+ 1547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:00.165183 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:00.165298 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:00.165468 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.165473 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.166548 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.166549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.167957 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.167959 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.168475 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.168476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.168613 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.169501 (+ 888us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:00.169506 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:00.172552 (+ 3046us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:00.174621 (+ 2069us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:00.174622 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:00.174623 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:00.175114 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:00.175323 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:00.175324 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:00.175324 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:00.175378 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:00.175667 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:00.175668 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:00.175704 (+ 36us) client_negotiation.cc:769] Sending connection context
0618 23:20:00.176106 (+ 402us) client_negotiation.cc:240] Negotiation successful
0618 23:20:00.176224 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"mutex_wait_us":109,"thread_start_us":234,"threads_started":1}
I20260618 23:20:00.176909 11031 heartbeater.cc:347] Connected to a master server at 127.3.217.190:43609
I20260618 23:20:00.177063 11033 heartbeater.cc:347] Connected to a master server at 127.3.217.189:32829
I20260618 23:20:00.177076 11031 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:00.177148 11033 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:00.177321 11033 heartbeater.cc:511] Master 127.3.217.189:32829 requested a full tablet report, sending...
I20260618 23:20:00.177321 11031 heartbeater.cc:511] Master 127.3.217.190:43609 requested a full tablet report, sending...
I20260618 23:20:00.177736 10060 ts_manager.cc:194] Re-registered known tserver with Master: c0480fa8257f4ff1bf279690478fe255 (127.3.217.129:36161)
I20260618 23:20:00.177997 10659 ts_manager.cc:194] Registered new tserver with Master: c0480fa8257f4ff1bf279690478fe255 (127.3.217.129:36161)
I20260618 23:20:00.178220 10060 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:52243
I20260618 23:20:00.179768 11037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.162943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35337 (local address 127.3.217.129:41183)
0618 23:20:00.164384 (+ 1441us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:00.164395 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:00.164455 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:00.164681 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:00.164681 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:00.165553 (+ 872us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:00.165602 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.165604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.166807 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.166808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.167957 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.167959 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.168477 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.168477 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.168613 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.169375 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:00.169380 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:00.172455 (+ 3075us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:00.177183 (+ 4728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:00.177184 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:00.177185 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:00.178620 (+ 1435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:00.179142 (+ 522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:00.179142 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:00.179143 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:00.179199 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:00.179523 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:00.179524 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:00.179554 (+ 30us) client_negotiation.cc:769] Sending connection context
0618 23:20:00.179608 (+ 54us) client_negotiation.cc:240] Negotiation successful
0618 23:20:00.179697 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1417,"mutex_wait_us":6,"thread_start_us":59,"threads_started":1}
I20260618 23:20:00.179950 11038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.162985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:41183 (local address 127.3.217.188:35337)
0618 23:20:00.163080 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.163082 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.164517 (+ 1435us) server_negotiation.cc:407] Connection header received
0618 23:20:00.164544 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.164545 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.164560 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.164628 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:00.165685 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.166697 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.168048 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.168351 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.168419 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.172578 (+ 4159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:00.172580 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:00.172580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:00.172588 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:00.177040 (+ 4452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.178990 (+ 1950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.178992 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.178993 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.179074 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.179292 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.179293 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.179294 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.179448 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:00.179535 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.179639 (+ 104us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.179746 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78,"thread_start_us":48,"threads_started":1}
I20260618 23:20:00.180408 11032 heartbeater.cc:347] Connected to a master server at 127.3.217.188:35337
I20260618 23:20:00.180471 11032 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:00.180550 11032 heartbeater.cc:511] Master 127.3.217.188:35337 requested a full tablet report, sending...
I20260618 23:20:00.180928 10852 ts_manager.cc:194] Registered new tserver with Master: c0480fa8257f4ff1bf279690478fe255 (127.3.217.129:36161)
W20260618 23:20:00.260514 11039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:00.260730 11039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:00.260756 11039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:00.262012 11039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:00.262058 11039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:00.262087 11039 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:20:00.263769 11039 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:33137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.130.keytab
--principal=oryx/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:37279
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=38345
--tserver_master_addrs=127.3.217.190:43609,127.3.217.189:32829,127.3.217.188:35337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:00.264041 11039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:00.264290 11039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:00.269871 11045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:00.269843 11047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:00.269843 11044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:00.270202 11039 server_base.cc:1034] running on GCE node
I20260618 23:20:00.270540 11039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:00.270819 11039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:00.272042 11039 hybrid_clock.cc:648] HybridClock initialized: now 1781824800272011 us; error 32 us; skew 500 ppm
Jun 18 23:20:00 dist-test-slave-r9ct krb5kdc[10015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824800, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:20:00.275564 11039 init.cc:377] Logged in from keytab as oryx/127.3.217.130@KRBTEST.COM (short username oryx)
I20260618 23:20:00.276400 11039 webserver.cc:460] Webserver started at http://127.3.217.130:38345/ using document root <none> and password file <none>
I20260618 23:20:00.276741 11039 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:00.276862 11039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:00.278283 11039 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:00.279143 11054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:00.279376 11039 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:00.279497 11039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "c776636e83564073b0724de19b9693ed"
format_stamp: "Formatted at 2026-06-18 23:19:59 on dist-test-slave-r9ct"
server_key: "51a1e20950c2dc488f4910898b792374"
server_key_iv: "d2f69967317e0dedbabaf627fccdd4e3"
server_key_version: "encryptionkey@0"
I20260618 23:20:00.279879 11039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:00.303660 11039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:00.306499 11039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:00.306681 11039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:00.306975 11039 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:20:00.307286 11039 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:20:00.307340 11039 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:00.307375 11039 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:20:00.307435 11039 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:00.313549 11039 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:37279
I20260618 23:20:00.313585 11167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:37279 every 8 connection(s)
I20260618 23:20:00.313944 11039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:20:00.317065 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 11039
I20260618 23:20:00.317236 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 10390
Jun 18 23:20:00 dist-test-slave-r9ct krb5kdc[10015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824800, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.189@KRBTEST.COM
Jun 18 23:20:00 dist-test-slave-r9ct krb5kdc[10015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824800, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.188@KRBTEST.COM
Jun 18 23:20:00 dist-test-slave-r9ct krb5kdc[10015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824800, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM
I20260618 23:20:00.324911 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:36449
--local_ip_for_outbound_sockets=127.3.217.131
--tserver_master_addrs=127.3.217.190:43609
--webserver_port=38345
--webserver_interface=127.3.217.131
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.131.keytab
--principal=oryx/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:33137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.3.217.190:43609,127.3.217.189:32829
--tserver_master_addrs=127.3.217.190:43609,127.3.217.189:32829,127.3.217.188:35337 with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260618 23:20:00.327569 11038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.314994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:40229 (local address 127.3.217.188:35337)
0618 23:20:00.315118 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.315120 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.315233 (+ 113us) server_negotiation.cc:407] Connection header received
0618 23:20:00.316272 (+ 1039us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.316273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.316291 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.316378 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:00.317696 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.318678 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.320659 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.320944 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.320985 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.324064 (+ 3079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:00.324065 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:00.324066 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:00.324073 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:00.325945 (+ 1872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.326449 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.326450 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.326450 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.326500 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.326808 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.326809 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.326809 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.326963 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:00.327015 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.327386 (+ 371us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.327474 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260618 23:20:00.327569 10710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.314893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:59937 (local address 127.3.217.189:32829)
0618 23:20:00.315040 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.315043 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.315225 (+ 182us) server_negotiation.cc:407] Connection header received
0618 23:20:00.316497 (+ 1272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.316498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.316510 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.316573 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:00.317697 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.318678 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.320387 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.320684 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.320720 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.324545 (+ 3825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:00.324546 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:00.324546 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:00.324553 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:00.326285 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.326652 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.326653 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.326654 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.326739 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.326933 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.326934 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.326934 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.327064 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:00.327112 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.327386 (+ 274us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.327473 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260618 23:20:00.328143 11174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.314824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:32829 (local address 127.3.217.130:59937)
0618 23:20:00.315083 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:00.315126 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:00.316004 (+ 878us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:00.316626 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:00.316626 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:00.317212 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:00.317452 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.317458 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.318975 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.318976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.320284 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.320287 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.320790 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.320790 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.320917 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.321577 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:00.321583 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:00.324449 (+ 2866us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:00.326362 (+ 1913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:00.326363 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:00.326363 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:00.326573 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:00.326816 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:00.326817 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:00.326817 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:00.326865 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:00.327140 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:00.327140 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:00.327211 (+ 71us) client_negotiation.cc:769] Sending connection context
0618 23:20:00.327737 (+ 526us) client_negotiation.cc:240] Negotiation successful
0618 23:20:00.327922 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":95,"threads_started":1}
I20260618 23:20:00.328204 11172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.314824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35337 (local address 127.3.217.130:40229)
0618 23:20:00.315083 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:00.315126 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:00.316004 (+ 878us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:00.316614 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:00.316619 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:00.317167 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:00.317452 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.317458 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.318821 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.318822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.320574 (+ 1752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.320576 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.321063 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.321064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.321611 (+ 547us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.322010 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:00.322014 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:00.323950 (+ 1936us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:00.326034 (+ 2084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:00.326041 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:00.326044 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:00.326362 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:00.326567 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:00.326568 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:00.326568 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:00.326693 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:00.327045 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:00.327050 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:00.327211 (+ 161us) client_negotiation.cc:769] Sending connection context
0618 23:20:00.328003 (+ 792us) client_negotiation.cc:240] Negotiation successful
0618 23:20:00.328083 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"mutex_wait_us":595,"thread_start_us":81,"threads_started":1}
I20260618 23:20:00.328642 11170 heartbeater.cc:347] Connected to a master server at 127.3.217.189:32829
I20260618 23:20:00.328750 11170 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:00.328879 11173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.314824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.3.217.130:60441)
0618 23:20:00.315332 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:00.315342 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:00.316060 (+ 718us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:00.317036 (+ 976us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:00.317038 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:00.317327 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:00.317452 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.317458 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.318518 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.318519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.320219 (+ 1700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.320222 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.320784 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.320785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.320922 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.321528 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:00.321538 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:00.324693 (+ 3155us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:00.327317 (+ 2624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:00.327318 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:00.327319 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:00.327552 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:00.327768 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:00.327769 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:00.327769 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:00.327823 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:00.328113 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:00.328114 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:00.328153 (+ 39us) client_negotiation.cc:769] Sending connection context
0618 23:20:00.328213 (+ 60us) client_negotiation.cc:240] Negotiation successful
0618 23:20:00.328600 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"mutex_wait_us":62,"thread_start_us":109,"threads_started":1}
I20260618 23:20:00.328943 11170 heartbeater.cc:511] Master 127.3.217.189:32829 requested a full tablet report, sending...
I20260618 23:20:00.329263 11169 heartbeater.cc:347] Connected to a master server at 127.3.217.188:35337
I20260618 23:20:00.329305 11169 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:00.329358 11169 heartbeater.cc:511] Master 127.3.217.188:35337 requested a full tablet report, sending...
I20260618 23:20:00.329383 10659 ts_manager.cc:194] Registered new tserver with Master: c776636e83564073b0724de19b9693ed (127.3.217.130:37279)
I20260618 23:20:00.329605 10852 ts_manager.cc:194] Registered new tserver with Master: c776636e83564073b0724de19b9693ed (127.3.217.130:37279)
I20260618 23:20:00.330040 10101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.314945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:60441 (local address 127.3.217.190:43609)
0618 23:20:00.315079 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.315081 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.315398 (+ 317us) server_negotiation.cc:407] Connection header received
0618 23:20:00.316417 (+ 1019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.316419 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.316430 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.316497 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:00.317581 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.318385 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.320319 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.320657 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.320699 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.325237 (+ 4538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:00.325238 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:00.325239 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:00.325246 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:00.327220 (+ 1974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.327642 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.327643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.327644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.327702 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.327924 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.327925 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.327925 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.328047 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:00.328120 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.329911 (+ 1791us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.329982 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260618 23:20:00.330392 11168 heartbeater.cc:347] Connected to a master server at 127.3.217.190:43609
I20260618 23:20:00.330449 11168 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:00.330524 11168 heartbeater.cc:511] Master 127.3.217.190:43609 requested a full tablet report, sending...
I20260618 23:20:00.330806 10060 ts_manager.cc:194] Re-registered known tserver with Master: c776636e83564073b0724de19b9693ed (127.3.217.130:37279)
I20260618 23:20:00.331207 10060 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:60441
I20260618 23:20:00.394800 10617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.392295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35337 (local address 127.0.0.1:38090)
0618 23:20:00.392341 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:00.392353 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:00.392434 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:00.392608 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:00.392609 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:00.392610 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:00.392663 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.392665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.393304 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.393306 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.394009 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.394011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.394555 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.394556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.394611 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.394615 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:20:00.394664 (+ 49us) client_negotiation.cc:240] Negotiation successful
0618 23:20:00.394702 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260618 23:20:00.394800 11038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.392389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38090 (local address 127.3.217.188:35337)
0618 23:20:00.392463 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.392465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.392476 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:20:00.392505 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.392506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.392532 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.392604 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:00.392738 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.393222 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.394098 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.394471 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.394555 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.394613 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.394679 (+ 66us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.394729 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260618 23:20:00.395074 10856 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260618 23:20:00.395184 10891 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 326fd11a8ff34d3faad92088c7933f35. Latest consensus state: current_term: 1 leader_uuid: "326fd11a8ff34d3faad92088c7933f35" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: NON_VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: true } } }
I20260618 23:20:00.395298 10891 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [sys.catalog]: This master's current role is: LEARNER
W20260618 23:20:00.414348 11175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:00.414593 11175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:00.414628 11175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:00.415796 11175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:00.415872 11175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:00.415916 11175 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:20:00.417387 11175 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:33137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.131.keytab
--principal=oryx/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:36449
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=38345
--tserver_master_addrs=127.3.217.190:43609,127.3.217.189:32829,127.3.217.188:35337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11175
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:00.417666 11175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:00.417914 11175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:00.423224 11183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:00.423183 11181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:00.423215 11175 server_base.cc:1034] running on GCE node
W20260618 23:20:00.423178 11180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:00.423851 11175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:00.424227 11175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:00.425462 11175 hybrid_clock.cc:648] HybridClock initialized: now 1781824800425422 us; error 80 us; skew 500 ppm
Jun 18 23:20:00 dist-test-slave-r9ct krb5kdc[10015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824800, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:20:00.428532 11175 init.cc:377] Logged in from keytab as oryx/127.3.217.131@KRBTEST.COM (short username oryx)
I20260618 23:20:00.429054 11175 webserver.cc:460] Webserver started at http://127.3.217.131:38345/ using document root <none> and password file <none>
I20260618 23:20:00.429279 11175 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:00.429334 11175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:00.430706 11175 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:20:00.431777 11190 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:00.432111 11175 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:00.432410 11175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "6d46d42947fe4b01b677d1188e0cf4c1"
format_stamp: "Formatted at 2026-06-18 23:19:59 on dist-test-slave-r9ct"
server_key: "6cad227622867c7638476656b875d93f"
server_key_iv: "2bf9ca1a21dcd7d509db28f096a2885a"
server_key_version: "encryptionkey@0"
I20260618 23:20:00.432791 11175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:00.463886 11175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:00.467172 11175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:00.467293 11175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:00.467590 11175 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:20:00.468104 11175 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:20:00.468182 11175 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:00.468222 11175 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:20:00.468252 11175 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:00.474145 11175 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:36449
I20260618 23:20:00.474215 11303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:36449 every 8 connection(s)
I20260618 23:20:00.474597 11175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:20:00.482292 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 11175
Jun 18 23:20:00 dist-test-slave-r9ct krb5kdc[10015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824800, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM
Jun 18 23:20:00 dist-test-slave-r9ct krb5kdc[10015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824800, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.188@KRBTEST.COM
Jun 18 23:20:00 dist-test-slave-r9ct krb5kdc[10015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824800, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.189@KRBTEST.COM
I20260618 23:20:00.490540 11308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.475384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35337 (local address 127.3.217.131:33639)
0618 23:20:00.475697 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:00.475742 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:00.476812 (+ 1070us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:00.477158 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:00.477159 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:00.477695 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:00.477955 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.477960 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.479034 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.479035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.480473 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.480475 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.480904 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.480905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.481756 (+ 851us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.482493 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:00.482498 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:00.484758 (+ 2260us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:00.487004 (+ 2246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:00.487011 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:00.487013 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:00.487385 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:00.488156 (+ 771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:00.488157 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:00.488157 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:00.489219 (+ 1062us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:00.489760 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:00.489766 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:00.489954 (+ 188us) client_negotiation.cc:769] Sending connection context
0618 23:20:00.490074 (+ 120us) client_negotiation.cc:240] Negotiation successful
0618 23:20:00.490265 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"mutex_wait_us":380,"thread_start_us":99,"threads_started":1}
I20260618 23:20:00.490859 11310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.475382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:32829 (local address 127.3.217.131:34707)
0618 23:20:00.475719 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:00.475749 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:00.476806 (+ 1057us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:00.477137 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:00.477143 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:00.477690 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:00.477955 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.477960 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.478913 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.478914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.480551 (+ 1637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.480552 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.481835 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.481837 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.481902 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.483295 (+ 1393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:00.483300 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:00.485725 (+ 2425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:00.489760 (+ 4035us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:00.489761 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:00.489761 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:00.489974 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:00.490210 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:00.490210 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:00.490211 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:00.490267 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:00.490526 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:00.490527 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:00.490568 (+ 41us) client_negotiation.cc:769] Sending connection context
0618 23:20:00.490617 (+ 49us) client_negotiation.cc:240] Negotiation successful
0618 23:20:00.490757 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":73,"thread_start_us":89,"threads_started":1}
I20260618 23:20:00.491130 11038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.475621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:33639 (local address 127.3.217.188:35337)
0618 23:20:00.475665 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.475667 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.475846 (+ 179us) server_negotiation.cc:407] Connection header received
0618 23:20:00.477047 (+ 1201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.477048 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.477059 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.477106 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:00.478059 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.478896 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.480596 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.480807 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.480894 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.484864 (+ 3970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:00.484865 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:00.484866 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:00.484873 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:00.486892 (+ 2019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.487897 (+ 1005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.487898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.487898 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.487960 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.489334 (+ 1374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.489335 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.489335 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.489664 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:00.489732 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.490838 (+ 1106us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.490924 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260618 23:20:00.491560 11305 heartbeater.cc:347] Connected to a master server at 127.3.217.188:35337
I20260618 23:20:00.491657 11305 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:00.491852 11305 heartbeater.cc:511] Master 127.3.217.188:35337 requested a full tablet report, sending...
I20260618 23:20:00.492133 10710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.475443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:34707 (local address 127.3.217.189:32829)
0618 23:20:00.475571 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.475573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.475866 (+ 293us) server_negotiation.cc:407] Connection header received
0618 23:20:00.477009 (+ 1143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.477011 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.477022 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.477074 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:00.478117 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.478700 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.480956 (+ 2256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.481657 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.481835 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.485943 (+ 4108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:00.485945 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:00.485945 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:00.485954 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:00.489649 (+ 3695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.490080 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.490081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.490081 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.490139 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.490339 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.490340 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.490341 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.490453 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:00.491757 (+ 1304us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.491802 (+ 45us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.491982 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260618 23:20:00.492462 10852 ts_manager.cc:194] Registered new tserver with Master: 6d46d42947fe4b01b677d1188e0cf4c1 (127.3.217.131:36449)
I20260618 23:20:00.493119 11306 heartbeater.cc:347] Connected to a master server at 127.3.217.189:32829
I20260618 23:20:00.493212 11306 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:00.493316 11306 heartbeater.cc:511] Master 127.3.217.189:32829 requested a full tablet report, sending...
I20260618 23:20:00.493666 10659 ts_manager.cc:194] Registered new tserver with Master: 6d46d42947fe4b01b677d1188e0cf4c1 (127.3.217.131:36449)
I20260618 23:20:00.494134 10101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.475507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:51093 (local address 127.3.217.190:43609)
0618 23:20:00.475628 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.475629 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.475886 (+ 257us) server_negotiation.cc:407] Connection header received
0618 23:20:00.476943 (+ 1057us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.476944 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.476957 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.477056 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:00.478168 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.478931 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.480601 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.480815 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.480847 (+ 32us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.484327 (+ 3480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:00.484329 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:00.484330 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:00.484337 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:00.487156 (+ 2819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.493170 (+ 6014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.493171 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.493172 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.493244 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.493487 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.493488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.493488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.493637 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:00.493687 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.493935 (+ 248us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.494033 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260618 23:20:00.494259 11316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.483527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59298 (local address 127.3.217.190:43609)
0618 23:20:00.483753 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.483755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.483899 (+ 144us) server_negotiation.cc:407] Connection header received
0618 23:20:00.484022 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.484023 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.484037 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.484091 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:00.485427 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.486331 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.487703 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.488067 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.488111 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.490039 (+ 1928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:00.490040 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:00.490040 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:00.490047 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:00.492354 (+ 2307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.493178 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.493180 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.493180 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.493337 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.493581 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.493582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.493582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.493736 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:00.493830 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.494057 (+ 227us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.494138 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":111,"threads_started":1}
I20260618 23:20:00.494480 11309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.475382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.3.217.131:51093)
0618 23:20:00.475712 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:00.475742 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:00.476807 (+ 1065us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:00.477138 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:00.477145 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:00.477731 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:00.477955 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.477961 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.479026 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.479027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.480486 (+ 1459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.480488 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.480957 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.480958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.481046 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.481876 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:00.481886 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:00.484200 (+ 2314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:00.487258 (+ 3058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:00.487258 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:00.487259 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:00.493069 (+ 5810us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:00.493325 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:00.493326 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:00.493327 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:00.493403 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:00.493743 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:00.493744 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:00.493791 (+ 47us) client_negotiation.cc:769] Sending connection context
0618 23:20:00.494235 (+ 444us) client_negotiation.cc:240] Negotiation successful
0618 23:20:00.494365 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":173,"thread_start_us":74,"threads_started":1}
I20260618 23:20:00.494903 11304 heartbeater.cc:347] Connected to a master server at 127.3.217.190:43609
I20260618 23:20:00.494956 11304 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:00.495038 11304 heartbeater.cc:511] Master 127.3.217.190:43609 requested a full tablet report, sending...
I20260618 23:20:00.495566 10060 ts_manager.cc:194] Re-registered known tserver with Master: 6d46d42947fe4b01b677d1188e0cf4c1 (127.3.217.131:36449)
I20260618 23:20:00.496461 10060 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:51093
I20260618 23:20:00.498628 11319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.486573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51968 (local address 127.3.217.189:32829)
0618 23:20:00.486777 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.486779 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.487015 (+ 236us) server_negotiation.cc:407] Connection header received
0618 23:20:00.487040 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.487041 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.487054 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.487109 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:00.488090 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.489518 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.490590 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.491029 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.491095 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.493833 (+ 2738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:00.493835 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:00.493836 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:00.493844 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:00.497295 (+ 3451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.497720 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.497721 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.497721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.497791 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.498042 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.498043 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.498044 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.498184 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:00.498267 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.498428 (+ 161us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.498522 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":92,"threads_started":1}
I20260618 23:20:00.496917 10060 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59298:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:20:00.499290 10060 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:20:00.499975 10816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "326fd11a8ff34d3faad92088c7933f35" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: NON_VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: true } } }
I20260618 23:20:00.500068 10816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: This master's current role is: LEADER
I20260618 23:20:00.502677 10620 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35: attempting to promote NON_VOTER 2541f54725c047a18cfa07b2a6968a0a to VOTER
I20260618 23:20:00.503125 10620 consensus_queue.cc:237] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: false } }
I20260618 23:20:00.503765 10669 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [term 1 FOLLOWER]: Refusing update from remote peer 326fd11a8ff34d3faad92088c7933f35: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260618 23:20:00.503969 10621 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260618 23:20:00.504199 10859 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 1 LEARNER]: Refusing update from remote peer 326fd11a8ff34d3faad92088c7933f35: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260618 23:20:00.504401 10621 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260618 23:20:00.504928 10669 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 2541f54725c047a18cfa07b2a6968a0a (127.3.217.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: false } } }
I20260618 23:20:00.505035 10859 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 2541f54725c047a18cfa07b2a6968a0a (127.3.217.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: false } } }
I20260618 23:20:00.505436 11318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.486416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38104 (local address 127.3.217.188:35337)
0618 23:20:00.486833 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.486836 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.495279 (+ 8443us) server_negotiation.cc:407] Connection header received
0618 23:20:00.495413 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.495414 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.495429 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.495501 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:00.496074 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.496916 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.498298 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.498671 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.498767 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.500753 (+ 1986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:00.500755 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:00.500755 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:00.500763 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:00.503297 (+ 2534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.503921 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.503922 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.503922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.503989 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.504202 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.504203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.504204 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.504374 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:00.504646 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.505227 (+ 581us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.505345 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":86,"threads_started":1}
I20260618 23:20:00.506107 10891 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "326fd11a8ff34d3faad92088c7933f35" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: false } } }
I20260618 23:20:00.506176 10891 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [sys.catalog]: This master's current role is: FOLLOWER
I20260618 23:20:00.506148 10815 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "326fd11a8ff34d3faad92088c7933f35" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: false } } }
I20260618 23:20:00.506237 10815 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [sys.catalog]: This master's current role is: FOLLOWER
I20260618 23:20:00.506688 10621 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 2541f54725c047a18cfa07b2a6968a0a (127.3.217.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: false } } }
I20260618 23:20:00.507858 10816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "326fd11a8ff34d3faad92088c7933f35" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: false } } }
I20260618 23:20:00.507956 10816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: This master's current role is: LEADER
I20260618 23:20:00.508170 10816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "326fd11a8ff34d3faad92088c7933f35" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: false } } }
I20260618 23:20:00.508188 10621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "326fd11a8ff34d3faad92088c7933f35" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: false } } }
I20260618 23:20:00.508236 10816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: This master's current role is: LEADER
I20260618 23:20:00.508239 10621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35 [sys.catalog]: This master's current role is: LEADER
I20260618 23:20:00.513332 11332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.509269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50186 (local address 127.3.217.129:36161)
0618 23:20:00.509814 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.509818 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.509827 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:20:00.509859 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.509860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.509873 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.509964 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:00.510052 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.511064 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.512268 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.512974 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.513068 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.513144 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.513203 (+ 59us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.513237 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":92,"threads_started":1}
I20260618 23:20:00.513334 10617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.508909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:36449 (local address 127.0.0.1:45292)
0618 23:20:00.508954 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:00.508967 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:00.509052 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:00.509709 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:00.509709 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:00.509711 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:00.509751 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.509753 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.510977 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.510979 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.511947 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.511954 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.513108 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.513109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.513180 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.513184 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:20:00.513214 (+ 30us) client_negotiation.cc:240] Negotiation successful
0618 23:20:00.513257 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":2}
I20260618 23:20:00.513526 11330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.509131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33600 (local address 127.3.217.130:37279)
0618 23:20:00.509299 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.509305 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.509315 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:20:00.509358 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.509361 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.509380 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.509462 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:00.509601 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.510697 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.512225 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.513005 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.513090 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.513162 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.513369 (+ 207us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.513427 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":103,"threads_started":1}
I20260618 23:20:00.513773 11331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.509282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45292 (local address 127.3.217.131:36449)
0618 23:20:00.509572 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.509575 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.509582 (+ 7us) server_negotiation.cc:407] Connection header received
0618 23:20:00.509610 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.509611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.509623 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.509711 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:00.509836 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.510900 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.512308 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.513005 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.513503 (+ 498us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.513664 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.513687 (+ 23us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.513718 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":76,"threads_started":1}
I20260618 23:20:00.513952 11328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.508965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:37279 (local address 127.0.0.1:33600)
0618 23:20:00.509106 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:00.509117 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:00.509167 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:00.509474 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:00.509475 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:00.509477 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:00.509530 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.509532 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.510812 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.510812 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.512032 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.512035 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.513191 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.513192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.513247 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.513250 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:20:00.513294 (+ 44us) client_negotiation.cc:240] Negotiation successful
0618 23:20:00.513327 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":41,"thread_start_us":97,"threads_started":1}
I20260618 23:20:00.514042 11329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.509009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:36161 (local address 127.0.0.1:50186)
0618 23:20:00.509384 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:00.509394 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:00.509438 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:00.509961 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:00.509961 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:00.509963 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:00.509997 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.509999 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.511149 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.511150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.512190 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.512191 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.513065 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.513066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.513124 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.513128 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:20:00.513185 (+ 57us) client_negotiation.cc:240] Negotiation successful
0618 23:20:00.513229 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":83,"threads_started":1}
I20260618 23:20:00.514482 11238 tablet_service.cc:1467] Processing CreateTablet for tablet cf36fe7e47734e208280beea8d1e45c6 (DEFAULT_TABLE table=test-table [id=ed114d4be4ca41f1abca7e7a6b44aa40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:20:00.514652 10965 tablet_service.cc:1467] Processing CreateTablet for tablet cf36fe7e47734e208280beea8d1e45c6 (DEFAULT_TABLE table=test-table [id=ed114d4be4ca41f1abca7e7a6b44aa40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:20:00.514889 11238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf36fe7e47734e208280beea8d1e45c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:00.514943 10965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf36fe7e47734e208280beea8d1e45c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:00.519572 11333 tablet_bootstrap.cc:492] T cf36fe7e47734e208280beea8d1e45c6 P 6d46d42947fe4b01b677d1188e0cf4c1: Bootstrap starting.
I20260618 23:20:00.519567 11102 tablet_service.cc:1467] Processing CreateTablet for tablet cf36fe7e47734e208280beea8d1e45c6 (DEFAULT_TABLE table=test-table [id=ed114d4be4ca41f1abca7e7a6b44aa40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:20:00.519811 11334 tablet_bootstrap.cc:492] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255: Bootstrap starting.
I20260618 23:20:00.520021 11102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf36fe7e47734e208280beea8d1e45c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:00.520488 11334 tablet_bootstrap.cc:654] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:00.520562 11333 tablet_bootstrap.cc:654] T cf36fe7e47734e208280beea8d1e45c6 P 6d46d42947fe4b01b677d1188e0cf4c1: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:00.520843 11334 log.cc:824] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255: Log is configured to *not* fsync() on all Append() calls
I20260618 23:20:00.520884 11333 log.cc:824] T cf36fe7e47734e208280beea8d1e45c6 P 6d46d42947fe4b01b677d1188e0cf4c1: Log is configured to *not* fsync() on all Append() calls
I20260618 23:20:00.521574 11334 tablet_bootstrap.cc:492] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255: No bootstrap required, opened a new log
I20260618 23:20:00.521659 11334 ts_tablet_manager.cc:1397] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:20:00.521668 11333 tablet_bootstrap.cc:492] T cf36fe7e47734e208280beea8d1e45c6 P 6d46d42947fe4b01b677d1188e0cf4c1: No bootstrap required, opened a new log
I20260618 23:20:00.521736 11333 ts_tablet_manager.cc:1397] T cf36fe7e47734e208280beea8d1e45c6 P 6d46d42947fe4b01b677d1188e0cf4c1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:20:00.523934 11334 raft_consensus.cc:348] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 } } peers { permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 } } peers { permanent_uuid: "c0480fa8257f4ff1bf279690478fe255" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 36161 } }
I20260618 23:20:00.524119 11334 raft_consensus.cc:374] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:00.524168 11334 raft_consensus.cc:729] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0480fa8257f4ff1bf279690478fe255, State: Initialized, Role: FOLLOWER
I20260618 23:20:00.524281 11334 consensus_queue.cc:260] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 } } peers { permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 } } peers { permanent_uuid: "c0480fa8257f4ff1bf279690478fe255" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 36161 } }
I20260618 23:20:00.524333 11337 tablet_bootstrap.cc:492] T cf36fe7e47734e208280beea8d1e45c6 P c776636e83564073b0724de19b9693ed: Bootstrap starting.
I20260618 23:20:00.524554 11334 ts_tablet_manager.cc:1428] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260618 23:20:00.524613 11031 heartbeater.cc:503] Master 127.3.217.190:43609 was elected leader, sending a full tablet report...
I20260618 23:20:00.524639 11333 raft_consensus.cc:348] T cf36fe7e47734e208280beea8d1e45c6 P 6d46d42947fe4b01b677d1188e0cf4c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 } } peers { permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 } } peers { permanent_uuid: "c0480fa8257f4ff1bf279690478fe255" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 36161 } }
I20260618 23:20:00.524794 11333 raft_consensus.cc:374] T cf36fe7e47734e208280beea8d1e45c6 P 6d46d42947fe4b01b677d1188e0cf4c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:00.524833 11333 raft_consensus.cc:729] T cf36fe7e47734e208280beea8d1e45c6 P 6d46d42947fe4b01b677d1188e0cf4c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d46d42947fe4b01b677d1188e0cf4c1, State: Initialized, Role: FOLLOWER
I20260618 23:20:00.525110 11333 consensus_queue.cc:260] T cf36fe7e47734e208280beea8d1e45c6 P 6d46d42947fe4b01b677d1188e0cf4c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 } } peers { permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 } } peers { permanent_uuid: "c0480fa8257f4ff1bf279690478fe255" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 36161 } }
I20260618 23:20:00.525368 11333 ts_tablet_manager.cc:1428] T cf36fe7e47734e208280beea8d1e45c6 P 6d46d42947fe4b01b677d1188e0cf4c1: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260618 23:20:00.525573 11304 heartbeater.cc:503] Master 127.3.217.190:43609 was elected leader, sending a full tablet report...
I20260618 23:20:00.525864 11337 tablet_bootstrap.cc:654] T cf36fe7e47734e208280beea8d1e45c6 P c776636e83564073b0724de19b9693ed: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:00.526412 11337 log.cc:824] T cf36fe7e47734e208280beea8d1e45c6 P c776636e83564073b0724de19b9693ed: Log is configured to *not* fsync() on all Append() calls
I20260618 23:20:00.527789 11337 tablet_bootstrap.cc:492] T cf36fe7e47734e208280beea8d1e45c6 P c776636e83564073b0724de19b9693ed: No bootstrap required, opened a new log
I20260618 23:20:00.528054 11337 ts_tablet_manager.cc:1397] T cf36fe7e47734e208280beea8d1e45c6 P c776636e83564073b0724de19b9693ed: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260618 23:20:00.531482 11337 raft_consensus.cc:348] T cf36fe7e47734e208280beea8d1e45c6 P c776636e83564073b0724de19b9693ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 } } peers { permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 } } peers { permanent_uuid: "c0480fa8257f4ff1bf279690478fe255" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 36161 } }
I20260618 23:20:00.531629 11337 raft_consensus.cc:374] T cf36fe7e47734e208280beea8d1e45c6 P c776636e83564073b0724de19b9693ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:00.531652 11337 raft_consensus.cc:729] T cf36fe7e47734e208280beea8d1e45c6 P c776636e83564073b0724de19b9693ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c776636e83564073b0724de19b9693ed, State: Initialized, Role: FOLLOWER
I20260618 23:20:00.531738 11337 consensus_queue.cc:260] T cf36fe7e47734e208280beea8d1e45c6 P c776636e83564073b0724de19b9693ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 } } peers { permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 } } peers { permanent_uuid: "c0480fa8257f4ff1bf279690478fe255" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 36161 } }
I20260618 23:20:00.532029 11337 ts_tablet_manager.cc:1428] T cf36fe7e47734e208280beea8d1e45c6 P c776636e83564073b0724de19b9693ed: Time spent starting tablet: real 0.004s user 0.002s sys 0.003s
I20260618 23:20:00.532186 11168 heartbeater.cc:503] Master 127.3.217.190:43609 was elected leader, sending a full tablet report...
W20260618 23:20:00.564795 11171 tablet.cc:2369] T cf36fe7e47734e208280beea8d1e45c6 P c776636e83564073b0724de19b9693ed: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260618 23:20:00.662972 11034 tablet.cc:2369] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260618 23:20:00.726501 11307 tablet.cc:2369] T cf36fe7e47734e208280beea8d1e45c6 P 6d46d42947fe4b01b677d1188e0cf4c1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 23:20:00.766192 11338 raft_consensus.cc:482] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:20:00.766376 11338 raft_consensus.cc:504] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 } } peers { permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 } } peers { permanent_uuid: "c0480fa8257f4ff1bf279690478fe255" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 36161 } }
I20260618 23:20:00.766870 11338 leader_election.cc:288] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d46d42947fe4b01b677d1188e0cf4c1 (127.3.217.131:36449), c776636e83564073b0724de19b9693ed (127.3.217.130:37279)
I20260618 23:20:00.769860 11343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.767151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:37279 (local address 127.3.217.129:47141)
0618 23:20:00.767292 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:00.767303 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:00.767399 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:00.767527 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:00.767528 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:00.767530 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:00.767584 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.767586 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.768291 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.768292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.769051 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.769053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.769594 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.769595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.769657 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.769668 (+ 11us) client_negotiation.cc:769] Sending connection context
0618 23:20:00.769736 (+ 68us) client_negotiation.cc:240] Negotiation successful
0618 23:20:00.769778 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":63,"threads_started":1}
I20260618 23:20:00.769845 11330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.767228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:47141 (local address 127.3.217.130:37279)
0618 23:20:00.767280 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.767283 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.767360 (+ 77us) server_negotiation.cc:407] Connection header received
0618 23:20:00.767463 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.767464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.767474 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.767525 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:00.767663 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.768206 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.769148 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.769510 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.769596 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.769604 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.769741 (+ 137us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.769777 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260618 23:20:00.770102 11342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.767188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:36449 (local address 127.3.217.129:54541)
0618 23:20:00.767331 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:00.767342 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:00.767414 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:00.767613 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:00.767614 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:00.767618 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:00.767663 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.767665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.768343 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.768344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.769129 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:00.769131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.769720 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.769721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:00.769855 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.769867 (+ 12us) client_negotiation.cc:769] Sending connection context
0618 23:20:00.769932 (+ 65us) client_negotiation.cc:240] Negotiation successful
0618 23:20:00.769984 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":62,"threads_started":1}
I20260618 23:20:00.770139 11122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf36fe7e47734e208280beea8d1e45c6" candidate_uuid: "c0480fa8257f4ff1bf279690478fe255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c776636e83564073b0724de19b9693ed" is_pre_election: true
I20260618 23:20:00.770205 11331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.767309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:54541 (local address 127.3.217.131:36449)
0618 23:20:00.767358 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.767360 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.767389 (+ 29us) server_negotiation.cc:407] Connection header received
0618 23:20:00.767504 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.767506 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.767517 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.767595 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:00.767747 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.768252 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.769240 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.769633 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.769722 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.769730 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.770079 (+ 349us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.770125 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260618 23:20:00.770272 11122 raft_consensus.cc:2454] T cf36fe7e47734e208280beea8d1e45c6 P c776636e83564073b0724de19b9693ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0480fa8257f4ff1bf279690478fe255 in term 0.
I20260618 23:20:00.770491 10920 leader_election.cc:302] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0480fa8257f4ff1bf279690478fe255, c776636e83564073b0724de19b9693ed; no voters:
I20260618 23:20:00.770532 11258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf36fe7e47734e208280beea8d1e45c6" candidate_uuid: "c0480fa8257f4ff1bf279690478fe255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" is_pre_election: true
I20260618 23:20:00.770628 11338 raft_consensus.cc:2781] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:20:00.770684 11338 raft_consensus.cc:482] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:20:00.770701 11258 raft_consensus.cc:2454] T cf36fe7e47734e208280beea8d1e45c6 P 6d46d42947fe4b01b677d1188e0cf4c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0480fa8257f4ff1bf279690478fe255 in term 0.
I20260618 23:20:00.770738 11338 raft_consensus.cc:3037] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:00.771507 11338 raft_consensus.cc:504] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 } } peers { permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 } } peers { permanent_uuid: "c0480fa8257f4ff1bf279690478fe255" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 36161 } }
I20260618 23:20:00.771670 11338 leader_election.cc:288] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255 [CANDIDATE]: Term 1 election: Requested vote from peers 6d46d42947fe4b01b677d1188e0cf4c1 (127.3.217.131:36449), c776636e83564073b0724de19b9693ed (127.3.217.130:37279)
I20260618 23:20:00.771852 11258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf36fe7e47734e208280beea8d1e45c6" candidate_uuid: "c0480fa8257f4ff1bf279690478fe255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d46d42947fe4b01b677d1188e0cf4c1"
I20260618 23:20:00.771934 11258 raft_consensus.cc:3037] T cf36fe7e47734e208280beea8d1e45c6 P 6d46d42947fe4b01b677d1188e0cf4c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:00.771992 11122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf36fe7e47734e208280beea8d1e45c6" candidate_uuid: "c0480fa8257f4ff1bf279690478fe255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c776636e83564073b0724de19b9693ed"
I20260618 23:20:00.772078 11122 raft_consensus.cc:3037] T cf36fe7e47734e208280beea8d1e45c6 P c776636e83564073b0724de19b9693ed [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:00.772665 11258 raft_consensus.cc:2454] T cf36fe7e47734e208280beea8d1e45c6 P 6d46d42947fe4b01b677d1188e0cf4c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0480fa8257f4ff1bf279690478fe255 in term 1.
I20260618 23:20:00.772851 10921 leader_election.cc:302] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d46d42947fe4b01b677d1188e0cf4c1, c0480fa8257f4ff1bf279690478fe255; no voters:
I20260618 23:20:00.772951 11338 raft_consensus.cc:2781] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:20:00.773005 11122 raft_consensus.cc:2454] T cf36fe7e47734e208280beea8d1e45c6 P c776636e83564073b0724de19b9693ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0480fa8257f4ff1bf279690478fe255 in term 1.
I20260618 23:20:00.773072 11338 raft_consensus.cc:686] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255 [term 1 LEADER]: Becoming Leader. State: Replica: c0480fa8257f4ff1bf279690478fe255, State: Running, Role: LEADER
I20260618 23:20:00.773279 11338 consensus_queue.cc:237] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 } } peers { permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 } } peers { permanent_uuid: "c0480fa8257f4ff1bf279690478fe255" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 36161 } }
I20260618 23:20:00.774096 10060 catalog_manager.cc:5495] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0480fa8257f4ff1bf279690478fe255 (127.3.217.129). New cstate: current_term: 1 leader_uuid: "c0480fa8257f4ff1bf279690478fe255" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0480fa8257f4ff1bf279690478fe255" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 36161 } health_report { overall_health: HEALTHY } } }
I20260618 23:20:00.801779 11332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.798814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50190 (local address 127.3.217.129:36161)
0618 23:20:00.798897 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.798899 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.798910 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:20:00.798984 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.798984 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.799023 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.799095 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:20:00.799292 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.799810 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.800643 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.800862 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.800948 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.801157 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:20:00.801517 (+ 360us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:20:00.801612 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.801689 (+ 77us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.801718 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260618 23:20:00.804085 11122 raft_consensus.cc:1261] T cf36fe7e47734e208280beea8d1e45c6 P c776636e83564073b0724de19b9693ed [term 1 FOLLOWER]: Refusing update from remote peer c0480fa8257f4ff1bf279690478fe255: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:20:00.804147 11258 raft_consensus.cc:1261] T cf36fe7e47734e208280beea8d1e45c6 P 6d46d42947fe4b01b677d1188e0cf4c1 [term 1 FOLLOWER]: Refusing update from remote peer c0480fa8257f4ff1bf279690478fe255: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:20:00.804451 11344 consensus_queue.cc:1035] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:20:00.804579 11338 consensus_queue.cc:1035] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:20:00.808223 11348 mvcc.cc:205] Tried to move back new op lower bound from 7298354384090390528 to 7298354383967895552. Current Snapshot: MvccSnapshot[applied={T|T < 7298354384090390528}]
I20260618 23:20:00.809412 11349 mvcc.cc:205] Tried to move back new op lower bound from 7298354384090390528 to 7298354383967895552. Current Snapshot: MvccSnapshot[applied={T|T < 7298354384090390528}]
I20260618 23:20:00.809986 11347 mvcc.cc:205] Tried to move back new op lower bound from 7298354384090390528 to 7298354383967895552. Current Snapshot: MvccSnapshot[applied={T|T < 7298354384090390528 or (T in {7298354384090390528})}]
I20260618 23:20:00.810348 10058 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59298:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:20:00.810508 10058 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59298:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:20:00.812028 10058 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 326fd11a8ff34d3faad92088c7933f35: Sending DeleteTablet for 3 replicas of tablet cf36fe7e47734e208280beea8d1e45c6
I20260618 23:20:00.812316 11102 tablet_service.cc:1514] Processing DeleteTablet for tablet cf36fe7e47734e208280beea8d1e45c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:20:00 UTC) from {username='oryx', principal='oryx/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:33600
I20260618 23:20:00.812448 11238 tablet_service.cc:1514] Processing DeleteTablet for tablet cf36fe7e47734e208280beea8d1e45c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:20:00 UTC) from {username='oryx', principal='oryx/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:45292
I20260618 23:20:00.812554 10965 tablet_service.cc:1514] Processing DeleteTablet for tablet cf36fe7e47734e208280beea8d1e45c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:20:00 UTC) from {username='oryx', principal='oryx/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:50186
I20260618 23:20:00.812747 11357 tablet_replica.cc:330] T cf36fe7e47734e208280beea8d1e45c6 P 6d46d42947fe4b01b677d1188e0cf4c1: stopping tablet replica
I20260618 23:20:00.812835 11357 raft_consensus.cc:2229] T cf36fe7e47734e208280beea8d1e45c6 P 6d46d42947fe4b01b677d1188e0cf4c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:20:00.812949 11357 raft_consensus.cc:2258] T cf36fe7e47734e208280beea8d1e45c6 P 6d46d42947fe4b01b677d1188e0cf4c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:20:00.813328 11356 tablet_replica.cc:330] T cf36fe7e47734e208280beea8d1e45c6 P c776636e83564073b0724de19b9693ed: stopping tablet replica
I20260618 23:20:00.813359 11357 ts_tablet_manager.cc:1905] T cf36fe7e47734e208280beea8d1e45c6 P 6d46d42947fe4b01b677d1188e0cf4c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:20:00.813482 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 10028
I20260618 23:20:00.813514 11356 raft_consensus.cc:2229] T cf36fe7e47734e208280beea8d1e45c6 P c776636e83564073b0724de19b9693ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:20:00.813625 11356 raft_consensus.cc:2258] T cf36fe7e47734e208280beea8d1e45c6 P c776636e83564073b0724de19b9693ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:20:00.814178 11356 ts_tablet_manager.cc:1905] T cf36fe7e47734e208280beea8d1e45c6 P c776636e83564073b0724de19b9693ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:20:00.815372 11357 ts_tablet_manager.cc:1918] T cf36fe7e47734e208280beea8d1e45c6 P 6d46d42947fe4b01b677d1188e0cf4c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:20:00.815438 11357 log.cc:1196] T cf36fe7e47734e208280beea8d1e45c6 P 6d46d42947fe4b01b677d1188e0cf4c1: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/cf36fe7e47734e208280beea8d1e45c6
I20260618 23:20:00.815704 11357 ts_tablet_manager.cc:1939] T cf36fe7e47734e208280beea8d1e45c6 P 6d46d42947fe4b01b677d1188e0cf4c1: Deleting consensus metadata
I20260618 23:20:00.816249 11356 ts_tablet_manager.cc:1918] T cf36fe7e47734e208280beea8d1e45c6 P c776636e83564073b0724de19b9693ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:20:00.816324 11356 log.cc:1196] T cf36fe7e47734e208280beea8d1e45c6 P c776636e83564073b0724de19b9693ed: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/cf36fe7e47734e208280beea8d1e45c6
I20260618 23:20:00.816578 11356 ts_tablet_manager.cc:1939] T cf36fe7e47734e208280beea8d1e45c6 P c776636e83564073b0724de19b9693ed: Deleting consensus metadata
I20260618 23:20:00.819092 11358 tablet_replica.cc:330] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255: stopping tablet replica
I20260618 23:20:00.819223 11358 raft_consensus.cc:2229] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255 [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:20:00.819340 11358 raft_consensus.cc:2258] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:20:00.819710 11358 ts_tablet_manager.cc:1905] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260618 23:20:00.821178 11056 connection.cc:535] server connection from 127.0.0.1:33600 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260618 23:20:00.821406 11194 connection.cc:535] server connection from 127.0.0.1:45292 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260618 23:20:00.821936 11358 ts_tablet_manager.cc:1918] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:20:00.822072 11358 log.cc:1196] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-0/wal/wals/cf36fe7e47734e208280beea8d1e45c6
I20260618 23:20:00.822470 11358 ts_tablet_manager.cc:1939] T cf36fe7e47734e208280beea8d1e45c6 P c0480fa8257f4ff1bf279690478fe255: Deleting consensus metadata
W20260618 23:20:00.823542 10921 connection.cc:441] server connection from 127.0.0.1:50186 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50186 (request call id 1) could send its response
I20260618 23:20:00.828461 11318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.812773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38116 (local address 127.3.217.188:35337)
0618 23:20:00.812814 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.812816 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.818933 (+ 6117us) server_negotiation.cc:407] Connection header received
0618 23:20:00.818990 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.818991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.819007 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.819076 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:00.820133 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.820933 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.822495 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.822813 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.822859 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.824758 (+ 1899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:00.824760 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:00.824760 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:00.824767 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:00.826969 (+ 2202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.827348 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.827349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.827349 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.827415 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.827631 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.827632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.827632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.827796 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:00.827894 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.828277 (+ 383us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.828352 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260618 23:20:00.834074 11038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.826052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38120 (local address 127.3.217.188:35337)
0618 23:20:00.826094 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.826097 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.826512 (+ 415us) server_negotiation.cc:407] Connection header received
0618 23:20:00.826597 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.826598 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.826608 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.826636 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:00.828002 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.828713 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.829695 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.829894 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.829984 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.831440 (+ 1456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:00.831441 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:00.831442 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:00.831449 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:00.832935 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.833292 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.833292 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.833293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.833344 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.833572 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.833573 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.833573 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.833700 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:00.833792 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.833894 (+ 102us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.833967 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260618 23:20:00.834314 11319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:00.826201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51982 (local address 127.3.217.189:32829)
0618 23:20:00.826251 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:00.826253 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:00.826316 (+ 63us) server_negotiation.cc:407] Connection header received
0618 23:20:00.826376 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:00.826377 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:00.826392 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:00.826462 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:00.827408 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.828189 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.829666 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:00.829988 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:00.830026 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:00.831686 (+ 1660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:00.831687 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:00.831688 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:00.831694 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:00.833154 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.833507 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.833509 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.833509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.833560 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:00.833717 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:00.833718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:00.833719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:00.833838 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:00.833925 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:00.834134 (+ 209us) server_negotiation.cc:299] Negotiation successful
0618 23:20:00.834214 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260618 23:20:01.810604 11367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:01.810145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.3.217.130:41841)
0618 23:20:01.810434 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:01.810534 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":79,"threads_started":1}
W20260618 23:20:01.810917 11168 heartbeater.cc:644] Failed to heartbeat to 127.3.217.190:43609 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
I20260618 23:20:01.811105 11368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:01.810710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.3.217.131:46331)
0618 23:20:01.810913 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:01.811046 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":89,"threads_started":1}
I20260618 23:20:01.811400 11369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:01.811170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.3.217.129:33303)
0618 23:20:01.811283 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:01.811352 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":63,"threads_started":1}
W20260618 23:20:01.811436 11304 heartbeater.cc:644] Failed to heartbeat to 127.3.217.190:43609 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
W20260618 23:20:01.811673 11031 heartbeater.cc:644] Failed to heartbeat to 127.3.217.190:43609 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
I20260618 23:20:02.312707 11370 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 326fd11a8ff34d3faad92088c7933f35)
I20260618 23:20:02.312845 11371 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 326fd11a8ff34d3faad92088c7933f35)
I20260618 23:20:02.312858 11370 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: false } }
I20260618 23:20:02.313056 11371 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: false } }
I20260618 23:20:02.313325 11371 leader_election.cc:288] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 326fd11a8ff34d3faad92088c7933f35 (127.3.217.190:43609), 8efdf00c53584d2bb4375e7c4ff02b96 (127.3.217.189:32829)
I20260618 23:20:02.313596 11372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.313345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.0.0.1:59790)
0618 23:20:02.313492 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.313542 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":46,"threads_started":1}
W20260618 23:20:02.313762 10643 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
I20260618 23:20:02.313982 11375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.313400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.0.0.1:59806)
0618 23:20:02.313888 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.313946 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":43,"threads_started":1}
W20260618 23:20:02.314071 10836 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
I20260618 23:20:02.313477 11370 leader_election.cc:288] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 326fd11a8ff34d3faad92088c7933f35 (127.3.217.190:43609), 2541f54725c047a18cfa07b2a6968a0a (127.3.217.188:35337)
I20260618 23:20:02.314499 11375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.314401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.0.0.1:59814)
0618 23:20:02.314448 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.314471 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":15}
I20260618 23:20:02.314561 11372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.314483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.0.0.1:59830)
0618 23:20:02.314516 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.314537 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260618 23:20:02.314561 10836 leader_election.cc:334] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 326fd11a8ff34d3faad92088c7933f35 (127.3.217.190:43609): Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
W20260618 23:20:02.314621 10643 leader_election.cc:334] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 326fd11a8ff34d3faad92088c7933f35 (127.3.217.190:43609): Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
I20260618 23:20:02.317386 11373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.313554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:32829 (local address 127.0.0.1:51990)
0618 23:20:02.314019 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.314029 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:02.314103 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:02.314298 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:02.314299 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:02.314301 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:02.314340 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:02.314342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.315412 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.315413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:02.316438 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:02.316440 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.317126 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.317127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:02.317194 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:02.317198 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:20:02.317272 (+ 74us) client_negotiation.cc:240] Negotiation successful
0618 23:20:02.317318 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":45,"threads_started":1}
I20260618 23:20:02.317399 11377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.313704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51990 (local address 127.3.217.189:32829)
0618 23:20:02.313782 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:02.313784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:02.314080 (+ 296us) server_negotiation.cc:407] Connection header received
0618 23:20:02.314176 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:02.314177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:02.314186 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:02.314233 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:02.314453 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.315305 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.316564 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.317021 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.317123 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:02.317134 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:02.317280 (+ 146us) server_negotiation.cc:299] Negotiation successful
0618 23:20:02.317334 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60,"thread_start_us":42,"threads_started":1}
I20260618 23:20:02.317631 10669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2541f54725c047a18cfa07b2a6968a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" is_pre_election: true
I20260618 23:20:02.317759 10669 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2541f54725c047a18cfa07b2a6968a0a in term 1.
I20260618 23:20:02.317844 11374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.313371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35337 (local address 127.0.0.1:38130)
0618 23:20:02.313540 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.313551 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:02.313613 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:02.314094 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:02.314095 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:02.314097 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:02.314184 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:02.314186 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.315398 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.315399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:02.316605 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:02.316607 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.317342 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.317345 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:02.317481 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:02.317489 (+ 8us) client_negotiation.cc:769] Sending connection context
0618 23:20:02.317621 (+ 132us) client_negotiation.cc:240] Negotiation successful
0618 23:20:02.317689 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":77,"threads_started":1}
I20260618 23:20:02.317946 10838 leader_election.cc:302] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2541f54725c047a18cfa07b2a6968a0a, 8efdf00c53584d2bb4375e7c4ff02b96; no voters: 326fd11a8ff34d3faad92088c7933f35
I20260618 23:20:02.318032 11376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.313620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38130 (local address 127.3.217.188:35337)
0618 23:20:02.313885 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:02.313888 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:02.313897 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:20:02.313928 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:02.313928 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:02.313940 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:02.314277 (+ 337us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:02.314317 (+ 40us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.315299 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.316728 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.317139 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.317237 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:02.317347 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:02.317898 (+ 551us) server_negotiation.cc:299] Negotiation successful
0618 23:20:02.317948 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":30,"threads_started":1}
I20260618 23:20:02.318115 11371 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260618 23:20:02.318163 11371 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 326fd11a8ff34d3faad92088c7933f35)
I20260618 23:20:02.318179 11371 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 1 FOLLOWER]: Advancing to term 2
I20260618 23:20:02.318192 10859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2541f54725c047a18cfa07b2a6968a0a" is_pre_election: true
I20260618 23:20:02.319131 11371 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: false } }
I20260618 23:20:02.319340 11371 leader_election.cc:288] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [CANDIDATE]: Term 2 election: Requested vote from peers 326fd11a8ff34d3faad92088c7933f35 (127.3.217.190:43609), 8efdf00c53584d2bb4375e7c4ff02b96 (127.3.217.189:32829)
I20260618 23:20:02.319401 10859 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8efdf00c53584d2bb4375e7c4ff02b96 in current term 2: Already voted for candidate 2541f54725c047a18cfa07b2a6968a0a in this term.
I20260618 23:20:02.319574 11373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.319446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.0.0.1:59832)
0618 23:20:02.319514 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.319545 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260618 23:20:02.319564 10669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2541f54725c047a18cfa07b2a6968a0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8efdf00c53584d2bb4375e7c4ff02b96"
I20260618 23:20:02.319658 10669 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [term 1 FOLLOWER]: Advancing to term 2
I20260618 23:20:02.320043 11373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.319836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.0.0.1:59846)
0618 23:20:02.319980 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.320018 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
W20260618 23:20:02.320199 10836 leader_election.cc:334] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 326fd11a8ff34d3faad92088c7933f35 (127.3.217.190:43609): Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
I20260618 23:20:02.320413 10646 leader_election.cc:302] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8efdf00c53584d2bb4375e7c4ff02b96; no voters: 2541f54725c047a18cfa07b2a6968a0a, 326fd11a8ff34d3faad92088c7933f35
I20260618 23:20:02.320828 10669 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2541f54725c047a18cfa07b2a6968a0a in term 2.
I20260618 23:20:02.320942 11370 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260618 23:20:02.321038 10838 leader_election.cc:302] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2541f54725c047a18cfa07b2a6968a0a, 8efdf00c53584d2bb4375e7c4ff02b96; no voters: 326fd11a8ff34d3faad92088c7933f35
I20260618 23:20:02.321267 11371 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 2 FOLLOWER]: Leader election won for term 2
I20260618 23:20:02.321447 11371 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [term 2 LEADER]: Becoming Leader. State: Replica: 2541f54725c047a18cfa07b2a6968a0a, State: Running, Role: LEADER
I20260618 23:20:02.321555 11371 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: false } }
I20260618 23:20:02.322058 11380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2541f54725c047a18cfa07b2a6968a0a. Latest consensus state: current_term: 2 leader_uuid: "2541f54725c047a18cfa07b2a6968a0a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: false } } }
I20260618 23:20:02.322160 11380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [sys.catalog]: This master's current role is: LEADER
I20260618 23:20:02.322341 11382 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:20:02.322798 11382 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:20:02.322866 11382 catalog_manager.cc:1259] Loaded cluster ID: b57bba0f0abe479a9a26d6963a0faac1
I20260618 23:20:02.322891 11382 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:20:02.323045 11382 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:20:02.323099 11382 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a: Loaded TSK: 0
I20260618 23:20:02.323186 11382 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:20:02.336483 10851 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38120:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:20:02.339010 10851 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:20:02.340288 11373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.340152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.0.0.1:59852)
0618 23:20:02.340210 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.340260 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260618 23:20:02.340294 10669 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [term 2 FOLLOWER]: Refusing update from remote peer 2541f54725c047a18cfa07b2a6968a0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260618 23:20:02.340590 11380 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260618 23:20:02.340806 11373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.340651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.0.0.1:59866)
0618 23:20:02.340742 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.340779 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260618 23:20:02.340939 10836 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a -> Peer 326fd11a8ff34d3faad92088c7933f35 (127.3.217.190:43609): Couldn't send request to peer 326fd11a8ff34d3faad92088c7933f35. Status: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260618 23:20:02.341260 11370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2541f54725c047a18cfa07b2a6968a0a. Latest consensus state: current_term: 2 leader_uuid: "2541f54725c047a18cfa07b2a6968a0a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: false } } }
I20260618 23:20:02.341387 11370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [sys.catalog]: This master's current role is: FOLLOWER
I20260618 23:20:02.342237 11370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "2541f54725c047a18cfa07b2a6968a0a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: false } } }
I20260618 23:20:02.342335 11370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8efdf00c53584d2bb4375e7c4ff02b96 [sys.catalog]: This master's current role is: FOLLOWER
I20260618 23:20:02.342788 11384 mvcc.cc:205] Tried to move back new op lower bound from 7298354390383427584 to 7298354390309838848. Current Snapshot: MvccSnapshot[applied={T|T < 7298354390383427584 or (T in {7298354390383427584})}]
I20260618 23:20:02.342126 11380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "2541f54725c047a18cfa07b2a6968a0a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "326fd11a8ff34d3faad92088c7933f35" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43609 } } peers { permanent_uuid: "8efdf00c53584d2bb4375e7c4ff02b96" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 32829 } attrs { promote: false } } peers { permanent_uuid: "2541f54725c047a18cfa07b2a6968a0a" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35337 } attrs { promote: false } } }
I20260618 23:20:02.342955 11380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a [sys.catalog]: This master's current role is: LEADER
I20260618 23:20:02.348652 11373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.344770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:37279 (local address 127.0.0.1:33604)
0618 23:20:02.344804 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.344817 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:02.344864 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:02.345283 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:02.345284 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:02.345286 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:02.345337 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:02.345339 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.346310 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.346311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:02.347211 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:02.347213 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.348347 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.348350 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:02.348433 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:02.348440 (+ 7us) client_negotiation.cc:769] Sending connection context
0618 23:20:02.348497 (+ 57us) client_negotiation.cc:240] Negotiation successful
0618 23:20:02.348560 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20,"mutex_wait_us":23}
I20260618 23:20:02.348755 11389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.344831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45306 (local address 127.3.217.131:36449)
0618 23:20:02.345104 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:02.345106 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:02.345267 (+ 161us) server_negotiation.cc:407] Connection header received
0618 23:20:02.345297 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:02.345298 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:02.345309 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:02.345365 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:02.345553 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.346111 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.347815 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.348399 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.348490 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:02.348502 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:02.348647 (+ 145us) server_negotiation.cc:299] Negotiation successful
0618 23:20:02.348684 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":63,"threads_started":1}
I20260618 23:20:02.349424 11392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.345097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50194 (local address 127.3.217.129:36161)
0618 23:20:02.345291 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:02.345293 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:02.345300 (+ 7us) server_negotiation.cc:407] Connection header received
0618 23:20:02.345324 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:02.345325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:02.345335 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:02.345433 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:02.345590 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.346303 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.347876 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.348630 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.349260 (+ 630us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:02.349279 (+ 19us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:02.349299 (+ 20us) server_negotiation.cc:299] Negotiation successful
0618 23:20:02.349362 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":53,"threads_started":1}
I20260618 23:20:02.349411 11390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.344945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33604 (local address 127.3.217.130:37279)
0618 23:20:02.345141 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:02.345144 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:02.345154 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:20:02.345183 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:02.345184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:02.345196 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:02.345267 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:02.345423 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.346222 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.347300 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.347966 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.348180 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:02.348207 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:02.349300 (+ 1093us) server_negotiation.cc:299] Negotiation successful
0618 23:20:02.349347 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":52,"threads_started":1}
I20260618 23:20:02.348755 11375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.344770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:36449 (local address 127.0.0.1:45306)
0618 23:20:02.345139 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.345151 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:02.345205 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:02.345378 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:02.345379 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:02.345382 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:02.345464 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:02.345466 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.346210 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.346211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:02.347709 (+ 1498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:02.347711 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.348498 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.348499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:02.348574 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:02.348578 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:20:02.348642 (+ 64us) client_negotiation.cc:240] Negotiation successful
0618 23:20:02.348688 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"mutex_wait_us":82}
I20260618 23:20:02.349174 11391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.345010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:36161 (local address 127.0.0.1:50194)
0618 23:20:02.345155 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.345165 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:02.345209 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:02.345475 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:02.345476 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:02.345478 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:02.345515 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:02.345517 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.346377 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.346378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:02.347777 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:02.347779 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.348854 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.348855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:02.349011 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:02.349016 (+ 5us) client_negotiation.cc:769] Sending connection context
0618 23:20:02.349067 (+ 51us) client_negotiation.cc:240] Negotiation successful
0618 23:20:02.349107 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":24,"thread_start_us":90,"threads_started":1}
I20260618 23:20:02.349771 11102 tablet_service.cc:1467] Processing CreateTablet for tablet b6adf904dced41c39d256f849da07b26 (DEFAULT_TABLE table=test-table [id=f6d2d6955b804be48299aacf0fe86c64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:20:02.349874 11238 tablet_service.cc:1467] Processing CreateTablet for tablet b6adf904dced41c39d256f849da07b26 (DEFAULT_TABLE table=test-table [id=f6d2d6955b804be48299aacf0fe86c64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:20:02.349893 11102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6adf904dced41c39d256f849da07b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:02.349982 11238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6adf904dced41c39d256f849da07b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:02.350196 10965 tablet_service.cc:1467] Processing CreateTablet for tablet b6adf904dced41c39d256f849da07b26 (DEFAULT_TABLE table=test-table [id=f6d2d6955b804be48299aacf0fe86c64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:20:02.350329 10965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6adf904dced41c39d256f849da07b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:02.351465 11394 tablet_bootstrap.cc:492] T b6adf904dced41c39d256f849da07b26 P 6d46d42947fe4b01b677d1188e0cf4c1: Bootstrap starting.
I20260618 23:20:02.351722 11395 tablet_bootstrap.cc:492] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255: Bootstrap starting.
I20260618 23:20:02.351894 11394 tablet_bootstrap.cc:654] T b6adf904dced41c39d256f849da07b26 P 6d46d42947fe4b01b677d1188e0cf4c1: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:02.352057 11395 tablet_bootstrap.cc:654] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:02.352222 11393 tablet_bootstrap.cc:492] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed: Bootstrap starting.
I20260618 23:20:02.352553 11394 tablet_bootstrap.cc:492] T b6adf904dced41c39d256f849da07b26 P 6d46d42947fe4b01b677d1188e0cf4c1: No bootstrap required, opened a new log
I20260618 23:20:02.352561 11395 tablet_bootstrap.cc:492] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255: No bootstrap required, opened a new log
I20260618 23:20:02.352619 11394 ts_tablet_manager.cc:1397] T b6adf904dced41c39d256f849da07b26 P 6d46d42947fe4b01b677d1188e0cf4c1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:02.352619 11395 ts_tablet_manager.cc:1397] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:02.352643 11393 tablet_bootstrap.cc:654] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:02.352741 11394 raft_consensus.cc:348] T b6adf904dced41c39d256f849da07b26 P 6d46d42947fe4b01b677d1188e0cf4c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 } } peers { permanent_uuid: "c0480fa8257f4ff1bf279690478fe255" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 36161 } } peers { permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 } }
I20260618 23:20:02.352737 11395 raft_consensus.cc:348] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 } } peers { permanent_uuid: "c0480fa8257f4ff1bf279690478fe255" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 36161 } } peers { permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 } }
I20260618 23:20:02.352830 11394 raft_consensus.cc:374] T b6adf904dced41c39d256f849da07b26 P 6d46d42947fe4b01b677d1188e0cf4c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:02.352830 11395 raft_consensus.cc:374] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:02.352860 11394 raft_consensus.cc:729] T b6adf904dced41c39d256f849da07b26 P 6d46d42947fe4b01b677d1188e0cf4c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d46d42947fe4b01b677d1188e0cf4c1, State: Initialized, Role: FOLLOWER
I20260618 23:20:02.352861 11395 raft_consensus.cc:729] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0480fa8257f4ff1bf279690478fe255, State: Initialized, Role: FOLLOWER
I20260618 23:20:02.352912 11395 consensus_queue.cc:260] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 } } peers { permanent_uuid: "c0480fa8257f4ff1bf279690478fe255" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 36161 } } peers { permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 } }
I20260618 23:20:02.352919 11394 consensus_queue.cc:260] T b6adf904dced41c39d256f849da07b26 P 6d46d42947fe4b01b677d1188e0cf4c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 } } peers { permanent_uuid: "c0480fa8257f4ff1bf279690478fe255" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 36161 } } peers { permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 } }
I20260618 23:20:02.353044 11395 ts_tablet_manager.cc:1428] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260618 23:20:02.353060 11394 ts_tablet_manager.cc:1428] T b6adf904dced41c39d256f849da07b26 P 6d46d42947fe4b01b677d1188e0cf4c1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260618 23:20:02.353732 11401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.353203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.3.217.129:55121)
0618 23:20:02.353655 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.353698 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":79,"threads_started":1}
I20260618 23:20:02.353868 11032 heartbeater.cc:503] Master 127.3.217.188:35337 was elected leader, sending a full tablet report...
I20260618 23:20:02.354074 11393 tablet_bootstrap.cc:492] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed: No bootstrap required, opened a new log
I20260618 23:20:02.354131 11393 ts_tablet_manager.cc:1397] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:20:02.354202 11401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.354049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.3.217.129:48317)
0618 23:20:02.354151 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.354176 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":65,"threads_started":1}
I20260618 23:20:02.354347 11305 heartbeater.cc:503] Master 127.3.217.188:35337 was elected leader, sending a full tablet report...
I20260618 23:20:02.354331 11393 raft_consensus.cc:348] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 } } peers { permanent_uuid: "c0480fa8257f4ff1bf279690478fe255" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 36161 } } peers { permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 } }
I20260618 23:20:02.354408 11393 raft_consensus.cc:374] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:02.354480 11393 raft_consensus.cc:729] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c776636e83564073b0724de19b9693ed, State: Initialized, Role: FOLLOWER
I20260618 23:20:02.354548 11393 consensus_queue.cc:260] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 } } peers { permanent_uuid: "c0480fa8257f4ff1bf279690478fe255" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 36161 } } peers { permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 } }
I20260618 23:20:02.354703 11393 ts_tablet_manager.cc:1428] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:02.355001 11402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.353481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.3.217.131:58099)
0618 23:20:02.354868 (+ 1387us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.354971 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1356,"thread_start_us":68,"threads_started":1}
I20260618 23:20:02.355304 11402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.355193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.3.217.131:40199)
0618 23:20:02.355252 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.355280 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260618 23:20:02.355564 11405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.354982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.3.217.130:35753)
0618 23:20:02.355497 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.355527 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":68,"threads_started":1}
I20260618 23:20:02.606313 11404 raft_consensus.cc:482] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:20:02.606462 11404 raft_consensus.cc:504] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 } } peers { permanent_uuid: "c0480fa8257f4ff1bf279690478fe255" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 36161 } } peers { permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 } }
I20260618 23:20:02.606909 11404 leader_election.cc:288] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d46d42947fe4b01b677d1188e0cf4c1 (127.3.217.131:36449), c0480fa8257f4ff1bf279690478fe255 (127.3.217.129:36161)
I20260618 23:20:02.609100 11399 raft_consensus.cc:482] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:20:02.609185 11399 raft_consensus.cc:504] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 } } peers { permanent_uuid: "c0480fa8257f4ff1bf279690478fe255" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 36161 } } peers { permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 } }
I20260618 23:20:02.609342 11399 leader_election.cc:288] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d46d42947fe4b01b677d1188e0cf4c1 (127.3.217.131:36449), c776636e83564073b0724de19b9693ed (127.3.217.130:37279)
I20260618 23:20:02.609543 11122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6adf904dced41c39d256f849da07b26" candidate_uuid: "c0480fa8257f4ff1bf279690478fe255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c776636e83564073b0724de19b9693ed" is_pre_election: true
I20260618 23:20:02.609547 11258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6adf904dced41c39d256f849da07b26" candidate_uuid: "c0480fa8257f4ff1bf279690478fe255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" is_pre_election: true
I20260618 23:20:02.609628 11122 raft_consensus.cc:2454] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0480fa8257f4ff1bf279690478fe255 in term 0.
I20260618 23:20:02.609629 11258 raft_consensus.cc:2454] T b6adf904dced41c39d256f849da07b26 P 6d46d42947fe4b01b677d1188e0cf4c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0480fa8257f4ff1bf279690478fe255 in term 0.
I20260618 23:20:02.609773 10920 leader_election.cc:302] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0480fa8257f4ff1bf279690478fe255, c776636e83564073b0724de19b9693ed; no voters:
I20260618 23:20:02.609902 11399 raft_consensus.cc:2781] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:20:02.609962 11399 raft_consensus.cc:482] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:20:02.609997 11399 raft_consensus.cc:3037] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:02.610813 11399 raft_consensus.cc:504] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 } } peers { permanent_uuid: "c0480fa8257f4ff1bf279690478fe255" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 36161 } } peers { permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 } }
I20260618 23:20:02.611075 11122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6adf904dced41c39d256f849da07b26" candidate_uuid: "c0480fa8257f4ff1bf279690478fe255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c776636e83564073b0724de19b9693ed"
I20260618 23:20:02.611140 11122 raft_consensus.cc:3037] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:02.611163 11258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6adf904dced41c39d256f849da07b26" candidate_uuid: "c0480fa8257f4ff1bf279690478fe255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d46d42947fe4b01b677d1188e0cf4c1"
I20260618 23:20:02.611251 11258 raft_consensus.cc:3037] T b6adf904dced41c39d256f849da07b26 P 6d46d42947fe4b01b677d1188e0cf4c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:02.611750 11392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.607297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:33287 (local address 127.3.217.129:36161)
0618 23:20:02.607396 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:02.607399 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:02.607539 (+ 140us) server_negotiation.cc:407] Connection header received
0618 23:20:02.607572 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:02.607573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:02.607583 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:02.607661 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:02.608040 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.608922 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.610700 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.611341 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.611432 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:02.611443 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:02.611629 (+ 186us) server_negotiation.cc:299] Negotiation successful
0618 23:20:02.611669 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260618 23:20:02.612064 11389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.607226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:45417 (local address 127.3.217.131:36449)
0618 23:20:02.607294 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:02.607296 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:02.607451 (+ 155us) server_negotiation.cc:407] Connection header received
0618 23:20:02.607561 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:02.607562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:02.607576 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:02.607661 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:02.608041 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.608989 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.610818 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.611439 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.611491 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:02.611501 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:02.611791 (+ 290us) server_negotiation.cc:299] Negotiation successful
0618 23:20:02.611966 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260618 23:20:02.612090 11406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.607173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:36161 (local address 127.3.217.130:33287)
0618 23:20:02.607447 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.607456 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:02.607518 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:02.607714 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:02.607716 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:02.607720 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:02.607856 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:02.607859 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.609044 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.609046 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:02.610588 (+ 1542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:02.610592 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.611476 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.611477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:02.611543 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:02.611547 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:20:02.611915 (+ 368us) client_negotiation.cc:240] Negotiation successful
0618 23:20:02.611971 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"mutex_wait_us":111,"thread_start_us":215,"threads_started":1}
I20260618 23:20:02.612118 11399 leader_election.cc:288] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255 [CANDIDATE]: Term 1 election: Requested vote from peers 6d46d42947fe4b01b677d1188e0cf4c1 (127.3.217.131:36449), c776636e83564073b0724de19b9693ed (127.3.217.130:37279)
I20260618 23:20:02.612133 11258 raft_consensus.cc:2454] T b6adf904dced41c39d256f849da07b26 P 6d46d42947fe4b01b677d1188e0cf4c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0480fa8257f4ff1bf279690478fe255 in term 1.
I20260618 23:20:02.612102 11122 raft_consensus.cc:2454] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0480fa8257f4ff1bf279690478fe255 in term 1.
I20260618 23:20:02.612301 10921 leader_election.cc:302] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d46d42947fe4b01b677d1188e0cf4c1, c0480fa8257f4ff1bf279690478fe255; no voters:
I20260618 23:20:02.612370 10983 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6adf904dced41c39d256f849da07b26" candidate_uuid: "c776636e83564073b0724de19b9693ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0480fa8257f4ff1bf279690478fe255" is_pre_election: true
I20260618 23:20:02.612455 11399 raft_consensus.cc:2781] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:20:02.612576 11399 raft_consensus.cc:686] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255 [term 1 LEADER]: Becoming Leader. State: Replica: c0480fa8257f4ff1bf279690478fe255, State: Running, Role: LEADER
I20260618 23:20:02.612779 11399 consensus_queue.cc:237] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 } } peers { permanent_uuid: "c0480fa8257f4ff1bf279690478fe255" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 36161 } } peers { permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 } }
I20260618 23:20:02.613134 11403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.612870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.3.217.129:54659)
0618 23:20:02.613053 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.613101 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
I20260618 23:20:02.612854 11405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.607054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:36449 (local address 127.3.217.130:45417)
0618 23:20:02.607204 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.607224 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:02.607458 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:02.607714 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:02.607716 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:02.607722 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:02.607857 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:02.607859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.609054 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.609056 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:02.610679 (+ 1623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:02.610681 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.611600 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.611601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:02.611689 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:02.611692 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:20:02.612185 (+ 493us) client_negotiation.cc:240] Negotiation successful
0618 23:20:02.612239 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":75}
I20260618 23:20:02.613657 11258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6adf904dced41c39d256f849da07b26" candidate_uuid: "c776636e83564073b0724de19b9693ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" is_pre_election: true
I20260618 23:20:02.613765 11258 raft_consensus.cc:2379] T b6adf904dced41c39d256f849da07b26 P 6d46d42947fe4b01b677d1188e0cf4c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c776636e83564073b0724de19b9693ed in current term 1: Already voted for candidate c0480fa8257f4ff1bf279690478fe255 in this term.
I20260618 23:20:02.613915 11058 leader_election.cc:302] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c776636e83564073b0724de19b9693ed; no voters: 6d46d42947fe4b01b677d1188e0cf4c1, c0480fa8257f4ff1bf279690478fe255
I20260618 23:20:02.613936 10851 catalog_manager.cc:5495] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0480fa8257f4ff1bf279690478fe255 (127.3.217.129). New cstate: current_term: 1 leader_uuid: "c0480fa8257f4ff1bf279690478fe255" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0480fa8257f4ff1bf279690478fe255" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 } health_report { overall_health: UNKNOWN } } }
I20260618 23:20:02.614075 11404 raft_consensus.cc:2726] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260618 23:20:02.640046 11392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.637200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50208 (local address 127.3.217.129:36161)
0618 23:20:02.637239 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:02.637241 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:02.637263 (+ 22us) server_negotiation.cc:407] Connection header received
0618 23:20:02.637390 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:02.637390 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:02.637401 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:02.637459 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:20:02.637623 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.638239 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.639259 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:02.639462 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:02.639528 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:02.639791 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:20:02.639818 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:20:02.639878 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:02.639968 (+ 90us) server_negotiation.cc:299] Negotiation successful
0618 23:20:02.639988 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260618 23:20:02.641049 11122 raft_consensus.cc:1261] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed [term 1 FOLLOWER]: Refusing update from remote peer c0480fa8257f4ff1bf279690478fe255: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:20:02.641287 11258 raft_consensus.cc:1261] T b6adf904dced41c39d256f849da07b26 P 6d46d42947fe4b01b677d1188e0cf4c1 [term 1 FOLLOWER]: Refusing update from remote peer c0480fa8257f4ff1bf279690478fe255: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:20:02.641462 11407 consensus_queue.cc:1035] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c776636e83564073b0724de19b9693ed" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:20:02.641572 11399 consensus_queue.cc:1035] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d46d42947fe4b01b677d1188e0cf4c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:20:02.642176 11169 heartbeater.cc:503] Master 127.3.217.188:35337 was elected leader, sending a full tablet report...
I20260618 23:20:02.642534 11402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.642428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.3.217.131:45679)
0618 23:20:02.642476 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.642506 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260618 23:20:02.642555 11405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.642439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.3.217.130:39245)
0618 23:20:02.642481 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.642522 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260618 23:20:02.643918 11403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.643778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.3.217.129:51939)
0618 23:20:02.643859 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.643887 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260618 23:20:02.644169 11405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.644073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.3.217.130:56793)
0618 23:20:02.644113 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.644138 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260618 23:20:02.644564 11402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.644480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:43609 (local address 127.3.217.131:37183)
0618 23:20:02.644514 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.644540 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:43609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260618 23:20:02.645958 10852 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38120:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:20:02.646055 10852 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38120:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:20:02.647578 10852 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2541f54725c047a18cfa07b2a6968a0a: Sending DeleteTablet for 3 replicas of tablet b6adf904dced41c39d256f849da07b26
I20260618 23:20:02.647991 11238 tablet_service.cc:1514] Processing DeleteTablet for tablet b6adf904dced41c39d256f849da07b26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:20:02 UTC) from {username='oryx', principal='oryx/127.3.217.188@KRBTEST.COM'} at 127.0.0.1:45306
I20260618 23:20:02.648027 10965 tablet_service.cc:1514] Processing DeleteTablet for tablet b6adf904dced41c39d256f849da07b26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:20:02 UTC) from {username='oryx', principal='oryx/127.3.217.188@KRBTEST.COM'} at 127.0.0.1:50194
I20260618 23:20:02.648077 11102 tablet_service.cc:1514] Processing DeleteTablet for tablet b6adf904dced41c39d256f849da07b26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:20:02 UTC) from {username='oryx', principal='oryx/127.3.217.188@KRBTEST.COM'} at 127.0.0.1:33604
I20260618 23:20:02.648234 11419 tablet_replica.cc:330] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255: stopping tablet replica
I20260618 23:20:02.648303 11419 raft_consensus.cc:2229] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255 [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:20:02.648321 11421 tablet_replica.cc:330] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed: stopping tablet replica
I20260618 23:20:02.648370 11419 raft_consensus.cc:2258] T b6adf904dced41c39d256f849da07b26 P c0480fa8257f4ff1bf279690478fe255 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:20:02.648382 11421 raft_consensus.cc:2229] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:20:02.648427 11421 raft_consensus.cc:2258] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:20:02.648589 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 10806
I20260618 23:20:02.649377 11420 tablet_replica.cc:330] T b6adf904dced41c39d256f849da07b26 P 6d46d42947fe4b01b677d1188e0cf4c1: stopping tablet replica
I20260618 23:20:02.649444 11420 raft_consensus.cc:2229] T b6adf904dced41c39d256f849da07b26 P 6d46d42947fe4b01b677d1188e0cf4c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:20:02.649490 11420 raft_consensus.cc:2258] T b6adf904dced41c39d256f849da07b26 P 6d46d42947fe4b01b677d1188e0cf4c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:20:02.649825 11420 ts_tablet_manager.cc:1905] T b6adf904dced41c39d256f849da07b26 P 6d46d42947fe4b01b677d1188e0cf4c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:20:02.650393 11421 ts_tablet_manager.cc:1905] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:20:02.651425 11420 ts_tablet_manager.cc:1918] T b6adf904dced41c39d256f849da07b26 P 6d46d42947fe4b01b677d1188e0cf4c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:20:02.651468 11420 log.cc:1196] T b6adf904dced41c39d256f849da07b26 P 6d46d42947fe4b01b677d1188e0cf4c1: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/b6adf904dced41c39d256f849da07b26
I20260618 23:20:02.651669 11420 ts_tablet_manager.cc:1939] T b6adf904dced41c39d256f849da07b26 P 6d46d42947fe4b01b677d1188e0cf4c1: Deleting consensus metadata
I20260618 23:20:02.652365 11421 ts_tablet_manager.cc:1918] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:20:02.652436 11421 log.cc:1196] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/b6adf904dced41c39d256f849da07b26
I20260618 23:20:02.652689 11421 ts_tablet_manager.cc:1939] T b6adf904dced41c39d256f849da07b26 P c776636e83564073b0724de19b9693ed: Deleting consensus metadata
I20260618 23:20:02.653156 10838 catalog_manager.cc:4841] TS c776636e83564073b0724de19b9693ed (127.3.217.130:37279): tablet b6adf904dced41c39d256f849da07b26 (table test-table [id=f6d2d6955b804be48299aacf0fe86c64]) successfully deleted
I20260618 23:20:02.655428 11373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:02.655321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:36161 (local address 127.0.0.1:50218)
0618 23:20:02.655364 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:02.655390 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.129:36161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260618 23:20:02.655601 10839 catalog_manager.cc:4584] TS c0480fa8257f4ff1bf279690478fe255 (127.3.217.129:36161): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b6adf904dced41c39d256f849da07b26: Network error: Client connection negotiation failed: client connection to 127.3.217.129:36161: connect: Connection refused (error 111)
I20260618 23:20:02.655615 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 11039
I20260618 23:20:02.655701 10839 catalog_manager.cc:4841] TS 6d46d42947fe4b01b677d1188e0cf4c1 (127.3.217.131:36449): tablet b6adf904dced41c39d256f849da07b26 (table test-table [id=f6d2d6955b804be48299aacf0fe86c64]) successfully deleted
I20260618 23:20:02.661468 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 11175
I20260618 23:20:02.666440 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 10524
I20260618 23:20:02.671546 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 10713
2026-06-18T23:20:02Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5249 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:20:02 dist-test-slave-r9ct krb5kdc[11424](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:20:02 dist-test-slave-r9ct krb5kdc[11424](info): set up 2 sockets
Jun 18 23:20:02 dist-test-slave-r9ct krb5kdc[11424](info): commencing operation
krb5kdc: starting...
W20260618 23:20:03.776015 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:20:03 dist-test-slave-r9ct krb5kdc[11424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:20:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:20:03Z Disabled control of system clock
WARNING: no policy specified for oryx/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.190.keytab.
Entry for principal oryx/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.190.keytab.
I20260618 23:20:03.907478 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:38697
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.190.keytab
--principal=oryx/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:42855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:38697
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:20:03.991778 11437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:03.992024 11437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:03.992059 11437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:03.993186 11437 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:20:03.993260 11437 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260618 23:20:03.993284 11437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:03.993304 11437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:03.993336 11437 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:20:03.993359 11437 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:20:03.994861 11437 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:42855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:38697
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.190.keytab
--principal=oryx/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:38697
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11437
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:03.995164 11437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:03.995385 11437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260618 23:20:04.001519 11437 server_base.cc:1034] running on GCE node
W20260618 23:20:04.001545 11443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:04.001545 11445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:04.001487 11442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:04.002007 11437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:04.002499 11437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:04.003695 11437 hybrid_clock.cc:648] HybridClock initialized: now 1781824804003649 us; error 57 us; skew 500 ppm
Jun 18 23:20:04 dist-test-slave-r9ct krb5kdc[11424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824804, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:20:04.006510 11437 init.cc:377] Logged in from keytab as oryx/127.3.217.190@KRBTEST.COM (short username oryx)
I20260618 23:20:04.007092 11437 webserver.cc:460] Webserver started at http://127.3.217.190:46549/ using document root <none> and password file <none>
I20260618 23:20:04.007328 11437 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:04.007398 11437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:04.007557 11437 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:20:04.008651 11437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "473f3a016c7348e6bc30c31c3a22e97c"
format_stamp: "Formatted at 2026-06-18 23:20:04 on dist-test-slave-r9ct"
server_key: "bf91032275fbd585d43c55175ccd2f64"
server_key_iv: "248f800db085d1a957e89ea744b0a09e"
server_key_version: "encryptionkey@0"
I20260618 23:20:04.009011 11437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "473f3a016c7348e6bc30c31c3a22e97c"
format_stamp: "Formatted at 2026-06-18 23:20:04 on dist-test-slave-r9ct"
server_key: "bf91032275fbd585d43c55175ccd2f64"
server_key_iv: "248f800db085d1a957e89ea744b0a09e"
server_key_version: "encryptionkey@0"
I20260618 23:20:04.010375 11437 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:20:04.011556 11452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:04.011984 11437 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:04.012213 11437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "473f3a016c7348e6bc30c31c3a22e97c"
format_stamp: "Formatted at 2026-06-18 23:20:04 on dist-test-slave-r9ct"
server_key: "bf91032275fbd585d43c55175ccd2f64"
server_key_iv: "248f800db085d1a957e89ea744b0a09e"
server_key_version: "encryptionkey@0"
I20260618 23:20:04.012300 11437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:04.032385 11437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:04.034817 11437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:04.035192 11437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:04.040602 11437 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:38697
I20260618 23:20:04.040683 11514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:38697 every 8 connection(s)
I20260618 23:20:04.041013 11437 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:20:04.042093 11515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:04.044060 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 11437
I20260618 23:20:04.044149 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:20:04.044412 3942 external_mini_cluster.cc:1428] Setting key 95bb29085fd1ffaffe167f3d76e7054e
I20260618 23:20:04.044950 11515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c: Bootstrap starting.
I20260618 23:20:04.045694 11515 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:04.046061 11515 log.cc:824] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c: Log is configured to *not* fsync() on all Append() calls
I20260618 23:20:04.046905 11515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c: No bootstrap required, opened a new log
I20260618 23:20:04.049286 11515 raft_consensus.cc:348] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "473f3a016c7348e6bc30c31c3a22e97c" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38697 } }
I20260618 23:20:04.049448 11515 raft_consensus.cc:374] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:04.049482 11515 raft_consensus.cc:729] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 473f3a016c7348e6bc30c31c3a22e97c, State: Initialized, Role: FOLLOWER
I20260618 23:20:04.049597 11515 consensus_queue.cc:260] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "473f3a016c7348e6bc30c31c3a22e97c" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38697 } }
I20260618 23:20:04.049667 11515 raft_consensus.cc:388] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:20:04.049705 11515 raft_consensus.cc:482] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:20:04.049749 11515 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:04.050519 11515 raft_consensus.cc:504] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "473f3a016c7348e6bc30c31c3a22e97c" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38697 } }
I20260618 23:20:04.050607 11515 leader_election.cc:302] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 473f3a016c7348e6bc30c31c3a22e97c; no voters:
I20260618 23:20:04.050803 11515 leader_election.cc:288] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:20:04.050869 11520 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:20:04.051057 11520 raft_consensus.cc:686] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c [term 1 LEADER]: Becoming Leader. State: Replica: 473f3a016c7348e6bc30c31c3a22e97c, State: Running, Role: LEADER
I20260618 23:20:04.051079 11515 sys_catalog.cc:564] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:20:04.051194 11520 consensus_queue.cc:237] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "473f3a016c7348e6bc30c31c3a22e97c" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38697 } }
Jun 18 23:20:04 dist-test-slave-r9ct krb5kdc[11424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM
I20260618 23:20:04.052383 11521 sys_catalog.cc:455] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "473f3a016c7348e6bc30c31c3a22e97c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "473f3a016c7348e6bc30c31c3a22e97c" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38697 } } }
I20260618 23:20:04.052487 11521 sys_catalog.cc:458] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c [sys.catalog]: This master's current role is: LEADER
I20260618 23:20:04.052698 11535 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:20:04.052738 11522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 473f3a016c7348e6bc30c31c3a22e97c. Latest consensus state: current_term: 1 leader_uuid: "473f3a016c7348e6bc30c31c3a22e97c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "473f3a016c7348e6bc30c31c3a22e97c" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38697 } } }
I20260618 23:20:04.052985 11522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c [sys.catalog]: This master's current role is: LEADER
I20260618 23:20:04.053261 11535 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:20:04.054764 11535 catalog_manager.cc:1347] Generated new cluster ID: 19c909a62bd74c7bb947033cf119e559
I20260618 23:20:04.054816 11535 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:20:04.056851 11518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.045084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39072 (local address 127.3.217.190:38697)
0618 23:20:04.045286 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:04.045297 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:04.045333 (+ 36us) server_negotiation.cc:407] Connection header received
0618 23:20:04.045969 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:04.045979 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:04.046041 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:04.046190 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:04.046996 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.048443 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.049230 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.049829 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.049941 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.052821 (+ 2880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:04.052825 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:04.052825 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:04.052836 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:04.055032 (+ 2196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:04.055370 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:04.055373 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:04.055373 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:04.055460 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:04.055620 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:04.055621 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:04.055621 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:04.055873 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:04.056018 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:04.056391 (+ 373us) server_negotiation.cc:299] Negotiation successful
0618 23:20:04.056512 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":101,"threads_started":1}
I20260618 23:20:04.088074 11535 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:20:04.088634 11535 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:20:04.090776 11535 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c: Generated new TSK 0
I20260618 23:20:04.090991 11535 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.3.217.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.217.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.217.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.129.keytab.
Entry for principal oryx/127.3.217.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.129.keytab.
I20260618 23:20:04.118597 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:38697
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.129.keytab
--principal=oryx/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:42855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:20:04.205235 11541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:04.205458 11541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:04.205497 11541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:04.206624 11541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:04.206692 11541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:04.206728 11541 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260618 23:20:04.206816 11541 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:20:04.208321 11541 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:42855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.129.keytab
--principal=oryx/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.217.190:38697
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11541
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:04.208580 11541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:04.208797 11541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:04.214035 11547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:04.214031 11546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:04.214031 11549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:04.214692 11541 server_base.cc:1034] running on GCE node
I20260618 23:20:04.214929 11541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:04.215185 11541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:04.216377 11541 hybrid_clock.cc:648] HybridClock initialized: now 1781824804216366 us; error 63 us; skew 500 ppm
Jun 18 23:20:04 dist-test-slave-r9ct krb5kdc[11424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824804, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:20:04.219269 11541 init.cc:377] Logged in from keytab as oryx/127.3.217.129@KRBTEST.COM (short username oryx)
I20260618 23:20:04.219883 11541 webserver.cc:460] Webserver started at http://127.3.217.129:37931/ using document root <none> and password file <none>
I20260618 23:20:04.220124 11541 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:04.220187 11541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:04.220500 11541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:20:04.221571 11541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "4f2d5a64f1c441deb9b1187016982214"
format_stamp: "Formatted at 2026-06-18 23:20:04 on dist-test-slave-r9ct"
server_key: "30c0714153f8d7d9546d85b3c511b732"
server_key_iv: "cd084b1e7a6f4978685d74adb327d672"
server_key_version: "encryptionkey@0"
I20260618 23:20:04.221930 11541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "4f2d5a64f1c441deb9b1187016982214"
format_stamp: "Formatted at 2026-06-18 23:20:04 on dist-test-slave-r9ct"
server_key: "30c0714153f8d7d9546d85b3c511b732"
server_key_iv: "cd084b1e7a6f4978685d74adb327d672"
server_key_version: "encryptionkey@0"
I20260618 23:20:04.223335 11541 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:20:04.224056 11556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:04.224225 11541 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260618 23:20:04.224321 11541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "4f2d5a64f1c441deb9b1187016982214"
format_stamp: "Formatted at 2026-06-18 23:20:04 on dist-test-slave-r9ct"
server_key: "30c0714153f8d7d9546d85b3c511b732"
server_key_iv: "cd084b1e7a6f4978685d74adb327d672"
server_key_version: "encryptionkey@0"
I20260618 23:20:04.224396 11541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:04.253506 11541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:04.255816 11541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:04.256002 11541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:04.256549 11541 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:20:04.256608 11541 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:04.256644 11541 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:20:04.256698 11541 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:04.263661 11541 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:43563
I20260618 23:20:04.263737 11671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:43563 every 8 connection(s)
I20260618 23:20:04.264045 11541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
Jun 18 23:20:04 dist-test-slave-r9ct krb5kdc[11424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824804, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM
I20260618 23:20:04.264195 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 11541
I20260618 23:20:04.264341 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:20:04.264581 3942 external_mini_cluster.cc:1428] Setting key 1aea5b6b79d2fdf37e47af99ef3b9d18
I20260618 23:20:04.267740 11565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.257148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:38697 (local address 127.3.217.129:60617)
0618 23:20:04.257308 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:04.257341 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:04.257935 (+ 594us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:04.258239 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:04.258245 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:04.258617 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:04.258877 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.258881 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.259967 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.259968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.261417 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.261420 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.261820 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.261822 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.261987 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.262584 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:04.262602 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:04.264653 (+ 2051us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:04.266362 (+ 1709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:04.266369 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:04.266372 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:04.266659 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:04.266884 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:04.266885 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:04.266885 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:04.266985 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:04.267289 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:04.267293 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:04.267395 (+ 102us) client_negotiation.cc:769] Sending connection context
0618 23:20:04.267482 (+ 87us) client_negotiation.cc:240] Negotiation successful
0618 23:20:04.267594 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":75,"threads_started":1}
I20260618 23:20:04.267750 11518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.257153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:60617 (local address 127.3.217.190:38697)
0618 23:20:04.257208 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:04.257210 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:04.257448 (+ 238us) server_negotiation.cc:407] Connection header received
0618 23:20:04.258078 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:04.258080 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:04.258093 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:04.258164 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:04.258981 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.259836 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.261509 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.261722 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.261777 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.264774 (+ 2997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:04.264775 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:04.264775 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:04.264783 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:04.266259 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:04.266749 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:04.266750 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:04.266751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:04.266816 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:04.267050 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:04.267050 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:04.267051 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:04.267223 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:04.267296 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:04.267522 (+ 226us) server_negotiation.cc:299] Negotiation successful
0618 23:20:04.267612 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260618 23:20:04.268358 11672 heartbeater.cc:347] Connected to a master server at 127.3.217.190:38697
I20260618 23:20:04.268450 11672 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:04.268632 11672 heartbeater.cc:511] Master 127.3.217.190:38697 requested a full tablet report, sending...
I20260618 23:20:04.269168 11468 ts_manager.cc:194] Registered new tserver with Master: 4f2d5a64f1c441deb9b1187016982214 (127.3.217.129:43563)
I20260618 23:20:04.270145 11468 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:60617
WARNING: no policy specified for oryx/127.3.217.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.217.130@KRBTEST.COM" created.
I20260618 23:20:04.276583 11518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.269305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:37725 (local address 127.3.217.190:38697)
0618 23:20:04.270340 (+ 1035us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:04.270342 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:04.270351 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:20:04.270370 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:04.270371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:04.270382 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:04.270449 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:04.270841 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.271308 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.272016 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.272219 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.272309 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.273257 (+ 948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:04.273258 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:04.273258 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:04.273265 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:04.275263 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:04.275631 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:04.275632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:04.275633 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:04.275690 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:04.275873 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:04.275875 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:04.275875 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:04.276022 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:04.276109 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:04.276435 (+ 326us) server_negotiation.cc:299] Negotiation successful
0618 23:20:04.276501 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1015}
I20260618 23:20:04.276593 11679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.269341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:38697 (local address 127.3.217.129:37725)
0618 23:20:04.269474 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:04.269484 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:04.269537 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:04.270468 (+ 931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:04.270469 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:04.270682 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:04.270761 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.270763 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.271404 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.271405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.271927 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.271929 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.272311 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.272312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.272376 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.272824 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:04.272829 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:04.273164 (+ 335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:04.275362 (+ 2198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:04.275362 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:04.275363 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:04.275530 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:04.275756 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:04.275756 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:04.275757 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:04.275814 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:04.276158 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:04.276159 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:04.276197 (+ 38us) client_negotiation.cc:769] Sending connection context
0618 23:20:04.276381 (+ 184us) client_negotiation.cc:240] Negotiation successful
0618 23:20:04.276488 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":87,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.217.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.130.keytab.
Entry for principal oryx/127.3.217.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.130.keytab.
I20260618 23:20:04.293349 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:38697
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.130.keytab
--principal=oryx/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:42855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:20:04.375223 11681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:04.375411 11681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:04.375433 11681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:04.376461 11681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:04.376495 11681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:04.376515 11681 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260618 23:20:04.376531 11681 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:20:04.378017 11681 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:42855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.130.keytab
--principal=oryx/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.217.190:38697
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11681
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:04.378193 11681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:04.378350 11681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:04.383232 11686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:04.383289 11689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:04.383256 11687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:04.383397 11681 server_base.cc:1034] running on GCE node
I20260618 23:20:04.383628 11681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:04.383860 11681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:04.385190 11681 hybrid_clock.cc:648] HybridClock initialized: now 1781824804385155 us; error 47 us; skew 500 ppm
Jun 18 23:20:04 dist-test-slave-r9ct krb5kdc[11424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824804, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:20:04.387760 11681 init.cc:377] Logged in from keytab as oryx/127.3.217.130@KRBTEST.COM (short username oryx)
I20260618 23:20:04.388221 11681 webserver.cc:460] Webserver started at http://127.3.217.130:39559/ using document root <none> and password file <none>
I20260618 23:20:04.388437 11681 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:04.388499 11681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:04.388649 11681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:20:04.389638 11681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "d0e911c72bde4b599396f0d97a6baf9a"
format_stamp: "Formatted at 2026-06-18 23:20:04 on dist-test-slave-r9ct"
server_key: "818fd08310118070f9deb74557052a6b"
server_key_iv: "4d8e46fee4198c642e70a4a72fa094cf"
server_key_version: "encryptionkey@0"
I20260618 23:20:04.389981 11681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "d0e911c72bde4b599396f0d97a6baf9a"
format_stamp: "Formatted at 2026-06-18 23:20:04 on dist-test-slave-r9ct"
server_key: "818fd08310118070f9deb74557052a6b"
server_key_iv: "4d8e46fee4198c642e70a4a72fa094cf"
server_key_version: "encryptionkey@0"
I20260618 23:20:04.391331 11681 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:20:04.392288 11696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:04.392558 11681 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:04.392659 11681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "d0e911c72bde4b599396f0d97a6baf9a"
format_stamp: "Formatted at 2026-06-18 23:20:04 on dist-test-slave-r9ct"
server_key: "818fd08310118070f9deb74557052a6b"
server_key_iv: "4d8e46fee4198c642e70a4a72fa094cf"
server_key_version: "encryptionkey@0"
I20260618 23:20:04.392738 11681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:04.404737 11681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:04.406992 11681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:04.407145 11681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:04.407714 11681 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:20:04.407763 11681 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:04.407801 11681 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:20:04.407820 11681 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 18 23:20:04 dist-test-slave-r9ct krb5kdc[11424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824804, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM
I20260618 23:20:04.414820 11681 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:36367
I20260618 23:20:04.414925 11811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:36367 every 8 connection(s)
I20260618 23:20:04.415207 11681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:20:04.417317 11705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.408048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:38697 (local address 127.3.217.130:41269)
0618 23:20:04.408204 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:04.408251 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:04.408770 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:04.409000 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:04.409004 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:04.409365 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:04.409656 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.409662 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.410762 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.410763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.411664 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.411666 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.412108 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.412109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.412227 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.412697 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:04.412711 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:04.414052 (+ 1341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:04.415931 (+ 1879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:04.415936 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:04.415938 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:04.416180 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:04.416434 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:04.416435 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:04.416435 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:04.416564 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:04.416818 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:04.416823 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:04.416951 (+ 128us) client_negotiation.cc:769] Sending connection context
0618 23:20:04.417055 (+ 104us) client_negotiation.cc:240] Negotiation successful
0618 23:20:04.417170 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":71,"threads_started":1}
I20260618 23:20:04.417383 11518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.408098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:41269 (local address 127.3.217.190:38697)
0618 23:20:04.408163 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:04.408166 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:04.408357 (+ 191us) server_negotiation.cc:407] Connection header received
0618 23:20:04.408877 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:04.408878 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:04.408890 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:04.408937 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:04.409757 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.410627 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.411779 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.411993 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.412086 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.414148 (+ 2062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:04.414149 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:04.414150 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:04.414157 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:04.415828 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:04.416289 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:04.416290 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:04.416290 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:04.416348 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:04.416628 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:04.416629 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:04.416630 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:04.416737 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:04.416793 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:04.417171 (+ 378us) server_negotiation.cc:299] Negotiation successful
0618 23:20:04.417294 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260618 23:20:04.418031 11812 heartbeater.cc:347] Connected to a master server at 127.3.217.190:38697
I20260618 23:20:04.418133 11812 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:04.418308 11812 heartbeater.cc:511] Master 127.3.217.190:38697 requested a full tablet report, sending...
I20260618 23:20:04.418583 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 11681
I20260618 23:20:04.418735 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:20:04.418751 11469 ts_manager.cc:194] Registered new tserver with Master: d0e911c72bde4b599396f0d97a6baf9a (127.3.217.130:36367)
I20260618 23:20:04.418947 3942 external_mini_cluster.cc:1428] Setting key aba5faa93a3baa5ad3f49d6f7d2f0041
I20260618 23:20:04.419238 11469 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:41269
I20260618 23:20:04.426517 11818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.419492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:38697 (local address 127.3.217.130:49789)
0618 23:20:04.419627 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:04.419637 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:04.419687 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:04.420456 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:04.420457 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:04.420642 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:04.420691 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.420692 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.421401 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.421402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.421973 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.421974 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.422385 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.422386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.422468 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.422972 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:04.422977 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:04.423272 (+ 295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:04.425186 (+ 1914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:04.425188 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:04.425188 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:04.425434 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:04.425653 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:04.425654 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:04.425654 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:04.425757 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:04.426118 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:04.426119 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:04.426193 (+ 74us) client_negotiation.cc:769] Sending connection context
0618 23:20:04.426271 (+ 78us) client_negotiation.cc:240] Negotiation successful
0618 23:20:04.426394 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":69,"threads_started":1}
I20260618 23:20:04.426517 11518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.420007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:49789 (local address 127.3.217.190:38697)
0618 23:20:04.420296 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:04.420303 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:04.420312 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:20:04.420329 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:04.420329 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:04.420339 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:04.420417 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:04.420778 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.421299 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.422076 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.422296 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.422384 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.423387 (+ 1003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:04.423388 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:04.423389 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:04.423396 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:04.425037 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:04.425517 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:04.425518 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:04.425518 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:04.425586 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:04.425864 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:04.425865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:04.425865 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:04.426044 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:04.426119 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:04.426300 (+ 181us) server_negotiation.cc:299] Negotiation successful
0618 23:20:04.426396 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263}
WARNING: no policy specified for oryx/127.3.217.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.217.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.217.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.131.keytab.
Entry for principal oryx/127.3.217.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.131.keytab.
I20260618 23:20:04.445649 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:38697
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.131.keytab
--principal=oryx/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:42855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:20:04.531510 11821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:04.531708 11821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:04.531733 11821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:04.533017 11821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:04.533072 11821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:04.533094 11821 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260618 23:20:04.533113 11821 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:20:04.534633 11821 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:42855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.131.keytab
--principal=oryx/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.217.190:38697
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:04.534912 11821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:04.535156 11821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:04.540424 11826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:04.540424 11827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:04.540439 11821 server_base.cc:1034] running on GCE node
W20260618 23:20:04.540474 11829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:04.540930 11821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:04.541201 11821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:04.542356 11821 hybrid_clock.cc:648] HybridClock initialized: now 1781824804542340 us; error 28 us; skew 500 ppm
Jun 18 23:20:04 dist-test-slave-r9ct krb5kdc[11424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824804, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:20:04.545948 11821 init.cc:377] Logged in from keytab as oryx/127.3.217.131@KRBTEST.COM (short username oryx)
I20260618 23:20:04.546447 11821 webserver.cc:460] Webserver started at http://127.3.217.131:35621/ using document root <none> and password file <none>
I20260618 23:20:04.546691 11821 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:04.546785 11821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:04.546942 11821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:20:04.547989 11821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "9be62c22063c452e9a6690890e66a8c1"
format_stamp: "Formatted at 2026-06-18 23:20:04 on dist-test-slave-r9ct"
server_key: "46ea830686da0444b00e05a8012bd092"
server_key_iv: "6edead057622eb6fd3033823571b663a"
server_key_version: "encryptionkey@0"
I20260618 23:20:04.548388 11821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "9be62c22063c452e9a6690890e66a8c1"
format_stamp: "Formatted at 2026-06-18 23:20:04 on dist-test-slave-r9ct"
server_key: "46ea830686da0444b00e05a8012bd092"
server_key_iv: "6edead057622eb6fd3033823571b663a"
server_key_version: "encryptionkey@0"
I20260618 23:20:04.549741 11821 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260618 23:20:04.550542 11836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:04.550776 11821 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:04.550860 11821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "9be62c22063c452e9a6690890e66a8c1"
format_stamp: "Formatted at 2026-06-18 23:20:04 on dist-test-slave-r9ct"
server_key: "46ea830686da0444b00e05a8012bd092"
server_key_iv: "6edead057622eb6fd3033823571b663a"
server_key_version: "encryptionkey@0"
I20260618 23:20:04.550912 11821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:04.578416 11821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:04.581756 11821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:04.581899 11821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:04.582582 11821 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:20:04.582635 11821 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:04.582665 11821 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:20:04.582682 11821 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:04.590152 11821 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:37945
I20260618 23:20:04.590229 11951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:37945 every 8 connection(s)
I20260618 23:20:04.590530 11821 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
Jun 18 23:20:04 dist-test-slave-r9ct krb5kdc[11424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824804, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM
I20260618 23:20:04.591387 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 11821
I20260618 23:20:04.591509 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:20:04.591696 3942 external_mini_cluster.cc:1428] Setting key 6cc0a92cacf02e6e9a242f822b01fab8
I20260618 23:20:04.594496 11518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.583263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:46035 (local address 127.3.217.190:38697)
0618 23:20:04.583342 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:04.583344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:04.583497 (+ 153us) server_negotiation.cc:407] Connection header received
0618 23:20:04.583979 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:04.583980 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:04.583994 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:04.584079 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:04.585147 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.586008 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.587614 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.588056 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.588147 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.591424 (+ 3277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:04.591426 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:04.591426 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:04.591433 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:04.593025 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:04.593415 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:04.593416 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:04.593417 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:04.593474 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:04.593708 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:04.593709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:04.593710 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:04.593828 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:04.593892 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:04.594353 (+ 461us) server_negotiation.cc:299] Negotiation successful
0618 23:20:04.594424 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260618 23:20:04.594906 11845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.583156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:38697 (local address 127.3.217.131:46035)
0618 23:20:04.583351 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:04.583401 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:04.583876 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:04.584160 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:04.584163 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:04.584669 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:04.585021 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.585027 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.586114 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.586115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.587543 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.587545 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.588173 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.588175 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.588325 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.588894 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:04.588904 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:04.591209 (+ 2305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:04.593104 (+ 1895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:04.593109 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:04.593111 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:04.593318 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:04.593542 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:04.593542 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:04.593543 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:04.593633 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:04.593969 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:04.593978 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:04.594147 (+ 169us) client_negotiation.cc:769] Sending connection context
0618 23:20:04.594294 (+ 147us) client_negotiation.cc:240] Negotiation successful
0618 23:20:04.594484 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":122,"threads_started":1}
I20260618 23:20:04.595592 11952 heartbeater.cc:347] Connected to a master server at 127.3.217.190:38697
I20260618 23:20:04.595677 11952 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:04.595904 11952 heartbeater.cc:511] Master 127.3.217.190:38697 requested a full tablet report, sending...
I20260618 23:20:04.596406 11469 ts_manager.cc:194] Registered new tserver with Master: 9be62c22063c452e9a6690890e66a8c1 (127.3.217.131:37945)
I20260618 23:20:04.596819 11469 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:46035
I20260618 23:20:04.602712 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.596827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:38697 (local address 127.3.217.131:43247)
0618 23:20:04.597050 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:04.597060 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:04.597122 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:04.597242 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:04.597243 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:04.597405 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:04.597457 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.597459 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.598154 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.598155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.598674 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.598675 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.599125 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.599126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.599180 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.599624 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:04.599629 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:04.599897 (+ 268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:04.601349 (+ 1452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:04.601350 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:04.601350 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:04.601533 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:04.601905 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:04.601906 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:04.601906 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:04.601967 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:04.602377 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:04.602378 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:04.602422 (+ 44us) client_negotiation.cc:769] Sending connection context
0618 23:20:04.602497 (+ 75us) client_negotiation.cc:240] Negotiation successful
0618 23:20:04.602575 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":63,"threads_started":1}
I20260618 23:20:04.602828 11518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.596885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:43247 (local address 127.3.217.190:38697)
0618 23:20:04.596951 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:04.596953 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:04.597127 (+ 174us) server_negotiation.cc:407] Connection header received
0618 23:20:04.597173 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:04.597174 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:04.597183 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:04.597241 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:04.597530 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.598045 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.598812 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.599015 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.599073 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.600031 (+ 958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:04.600032 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:04.600033 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:04.600038 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:04.601249 (+ 1211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:04.601700 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:04.601701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:04.601701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:04.601802 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:04.602082 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:04.602083 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:04.602083 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:04.602209 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:04.602370 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:04.602598 (+ 228us) server_negotiation.cc:299] Negotiation successful
0618 23:20:04.602684 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260618 23:20:04.603205 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 18 23:20:04 dist-test-slave-r9ct krb5kdc[11424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824804, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 18 23:20:04 dist-test-slave-r9ct krb5kdc[11424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:04 dist-test-slave-r9ct krb5kdc[11424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
W20260618 23:20:04.625519 11518 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:04.619622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39082 (local address 127.3.217.190:38697)
0618 23:20:04.619683 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:04.619685 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:04.619693 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:20:04.619712 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:04.619712 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:04.619720 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:04.619768 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:04.620332 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.620812 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.621555 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.621725 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.621785 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.625437 (+ 3652us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39082: BlockingRecv error: recv got EOF from 127.0.0.1:39082 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Jun 18 23:20:04 dist-test-slave-r9ct krb5kdc[11424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824804, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM
I20260618 23:20:04.633438 11518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.626526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39086 (local address 127.3.217.190:38697)
0618 23:20:04.626597 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:04.626599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:04.626682 (+ 83us) server_negotiation.cc:407] Connection header received
0618 23:20:04.626792 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:04.626792 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:04.626802 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:04.626925 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:04.627394 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.627849 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.628531 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.628711 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.628784 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.631117 (+ 2333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:04.631118 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:04.631119 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:04.631126 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:04.632340 (+ 1214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:04.632684 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:04.632685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:04.632685 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:04.632737 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:04.632956 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:04.632958 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:04.632958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:04.633075 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:04.633180 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:04.633284 (+ 104us) server_negotiation.cc:299] Negotiation successful
0618 23:20:04.633352 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260618 23:20:04.635499 11469 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39086:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:20:04.637007 11469 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:20:04.644213 11976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.640061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:36367 (local address 127.0.0.1:33048)
0618 23:20:04.640427 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:04.640464 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:04.640536 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:04.640842 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:04.640842 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:04.640844 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:04.640887 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.640888 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.641736 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.641737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.642762 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.642765 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.643935 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.643935 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.644008 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.644021 (+ 13us) client_negotiation.cc:769] Sending connection context
0618 23:20:04.644092 (+ 71us) client_negotiation.cc:240] Negotiation successful
0618 23:20:04.644141 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":88,"threads_started":1}
I20260618 23:20:04.644347 11977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.640187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43710 (local address 127.3.217.129:43563)
0618 23:20:04.640368 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:04.640374 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:04.640593 (+ 219us) server_negotiation.cc:407] Connection header received
0618 23:20:04.640638 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:04.640640 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:04.640657 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:04.640742 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:04.640970 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.642068 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.643222 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.644009 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.644077 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.644137 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:04.644224 (+ 87us) server_negotiation.cc:299] Negotiation successful
0618 23:20:04.644257 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":82,"threads_started":1}
I20260618 23:20:04.644662 11975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.640091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:37945 (local address 127.0.0.1:39114)
0618 23:20:04.640503 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:04.640526 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:04.640575 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:04.640857 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:04.640857 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:04.640860 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:04.640904 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.640906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.642789 (+ 1883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.642790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.643571 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.643572 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.644450 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.644451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.644504 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.644508 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:20:04.644565 (+ 57us) client_negotiation.cc:240] Negotiation successful
0618 23:20:04.644598 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":94,"threads_started":1}
I20260618 23:20:04.644659 11978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.640313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33048 (local address 127.3.217.130:36367)
0618 23:20:04.640676 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:04.640681 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:04.640689 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:20:04.640724 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:04.640726 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:04.640740 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:04.640839 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:04.640945 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.641647 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.642855 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.643840 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.643930 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.644006 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:04.644441 (+ 435us) server_negotiation.cc:299] Negotiation successful
0618 23:20:04.644480 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":78,"threads_started":1}
I20260618 23:20:04.644909 11974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.640061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:43563 (local address 127.0.0.1:43710)
0618 23:20:04.640492 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:04.640501 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:04.640553 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:04.640765 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:04.640768 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:04.640770 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:04.640827 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.640828 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.642201 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.642202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.643043 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.643045 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.644080 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.644081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.644147 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.644151 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:20:04.644209 (+ 58us) client_negotiation.cc:240] Negotiation successful
0618 23:20:04.644247 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"mutex_wait_us":2,"thread_start_us":71,"threads_started":1}
I20260618 23:20:04.645291 11979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.640310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39114 (local address 127.3.217.131:37945)
0618 23:20:04.640658 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:04.640662 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:04.640672 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:20:04.640711 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:04.640713 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:04.640727 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:04.640800 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:04.640983 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.642067 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.643655 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.644273 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.644345 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.644411 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:04.644815 (+ 404us) server_negotiation.cc:299] Negotiation successful
0618 23:20:04.645184 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":94,"threads_started":1}
I20260618 23:20:04.645586 11606 tablet_service.cc:1467] Processing CreateTablet for tablet fe7a0bf0e1924aafa9bb767370dd3efc (DEFAULT_TABLE table=test-table [id=02ed2f9d234f480bb2034007edc12fe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:20:04.645973 11606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe7a0bf0e1924aafa9bb767370dd3efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:04.645915 11746 tablet_service.cc:1467] Processing CreateTablet for tablet fe7a0bf0e1924aafa9bb767370dd3efc (DEFAULT_TABLE table=test-table [id=02ed2f9d234f480bb2034007edc12fe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:20:04.646025 11886 tablet_service.cc:1467] Processing CreateTablet for tablet fe7a0bf0e1924aafa9bb767370dd3efc (DEFAULT_TABLE table=test-table [id=02ed2f9d234f480bb2034007edc12fe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:20:04.646232 11746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe7a0bf0e1924aafa9bb767370dd3efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:04.646283 11886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe7a0bf0e1924aafa9bb767370dd3efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:04.650585 11980 tablet_bootstrap.cc:492] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a: Bootstrap starting.
I20260618 23:20:04.652570 11980 tablet_bootstrap.cc:654] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:04.652714 11982 tablet_bootstrap.cc:492] T fe7a0bf0e1924aafa9bb767370dd3efc P 9be62c22063c452e9a6690890e66a8c1: Bootstrap starting.
I20260618 23:20:04.653016 11981 tablet_bootstrap.cc:492] T fe7a0bf0e1924aafa9bb767370dd3efc P 4f2d5a64f1c441deb9b1187016982214: Bootstrap starting.
I20260618 23:20:04.653100 11980 log.cc:824] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a: Log is configured to *not* fsync() on all Append() calls
I20260618 23:20:04.653410 11982 tablet_bootstrap.cc:654] T fe7a0bf0e1924aafa9bb767370dd3efc P 9be62c22063c452e9a6690890e66a8c1: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:04.653693 11981 tablet_bootstrap.cc:654] T fe7a0bf0e1924aafa9bb767370dd3efc P 4f2d5a64f1c441deb9b1187016982214: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:04.653741 11982 log.cc:824] T fe7a0bf0e1924aafa9bb767370dd3efc P 9be62c22063c452e9a6690890e66a8c1: Log is configured to *not* fsync() on all Append() calls
I20260618 23:20:04.654095 11981 log.cc:824] T fe7a0bf0e1924aafa9bb767370dd3efc P 4f2d5a64f1c441deb9b1187016982214: Log is configured to *not* fsync() on all Append() calls
I20260618 23:20:04.654345 11980 tablet_bootstrap.cc:492] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a: No bootstrap required, opened a new log
I20260618 23:20:04.654433 11980 ts_tablet_manager.cc:1397] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260618 23:20:04.654458 11982 tablet_bootstrap.cc:492] T fe7a0bf0e1924aafa9bb767370dd3efc P 9be62c22063c452e9a6690890e66a8c1: No bootstrap required, opened a new log
I20260618 23:20:04.654551 11982 ts_tablet_manager.cc:1397] T fe7a0bf0e1924aafa9bb767370dd3efc P 9be62c22063c452e9a6690890e66a8c1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:20:04.655105 11981 tablet_bootstrap.cc:492] T fe7a0bf0e1924aafa9bb767370dd3efc P 4f2d5a64f1c441deb9b1187016982214: No bootstrap required, opened a new log
I20260618 23:20:04.655184 11981 ts_tablet_manager.cc:1397] T fe7a0bf0e1924aafa9bb767370dd3efc P 4f2d5a64f1c441deb9b1187016982214: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:20:04.656505 11980 raft_consensus.cc:348] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.656679 11980 raft_consensus.cc:374] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:04.656715 11980 raft_consensus.cc:729] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0e911c72bde4b599396f0d97a6baf9a, State: Initialized, Role: FOLLOWER
I20260618 23:20:04.656857 11980 consensus_queue.cc:260] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.656948 11982 raft_consensus.cc:348] T fe7a0bf0e1924aafa9bb767370dd3efc P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.657096 11982 raft_consensus.cc:374] T fe7a0bf0e1924aafa9bb767370dd3efc P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:04.657110 11980 ts_tablet_manager.cc:1428] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260618 23:20:04.657132 11982 raft_consensus.cc:729] T fe7a0bf0e1924aafa9bb767370dd3efc P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9be62c22063c452e9a6690890e66a8c1, State: Initialized, Role: FOLLOWER
I20260618 23:20:04.657079 11981 raft_consensus.cc:348] T fe7a0bf0e1924aafa9bb767370dd3efc P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.657240 11812 heartbeater.cc:503] Master 127.3.217.190:38697 was elected leader, sending a full tablet report...
I20260618 23:20:04.657279 11981 raft_consensus.cc:374] T fe7a0bf0e1924aafa9bb767370dd3efc P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:04.657258 11982 consensus_queue.cc:260] T fe7a0bf0e1924aafa9bb767370dd3efc P 9be62c22063c452e9a6690890e66a8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.657325 11981 raft_consensus.cc:729] T fe7a0bf0e1924aafa9bb767370dd3efc P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f2d5a64f1c441deb9b1187016982214, State: Initialized, Role: FOLLOWER
I20260618 23:20:04.657438 11981 consensus_queue.cc:260] T fe7a0bf0e1924aafa9bb767370dd3efc P 4f2d5a64f1c441deb9b1187016982214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.657486 11982 ts_tablet_manager.cc:1428] T fe7a0bf0e1924aafa9bb767370dd3efc P 9be62c22063c452e9a6690890e66a8c1: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260618 23:20:04.657613 11952 heartbeater.cc:503] Master 127.3.217.190:38697 was elected leader, sending a full tablet report...
I20260618 23:20:04.657694 11981 ts_tablet_manager.cc:1428] T fe7a0bf0e1924aafa9bb767370dd3efc P 4f2d5a64f1c441deb9b1187016982214: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:20:04.657826 11672 heartbeater.cc:503] Master 127.3.217.190:38697 was elected leader, sending a full tablet report...
W20260618 23:20:04.665760 11813 tablet.cc:2369] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 23:20:04.681782 11986 raft_consensus.cc:482] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:20:04.681965 11986 raft_consensus.cc:504] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.682307 11986 leader_election.cc:288] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f2d5a64f1c441deb9b1187016982214 (127.3.217.129:43563), 9be62c22063c452e9a6690890e66a8c1 (127.3.217.131:37945)
I20260618 23:20:04.685168 11705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.682521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:43563 (local address 127.3.217.130:46667)
0618 23:20:04.682601 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:04.682615 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:04.682674 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:04.682885 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:04.682886 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:04.682888 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:04.682952 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.682954 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.683606 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.683607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.684358 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.684360 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.684896 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.684897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.684986 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.684989 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:20:04.685052 (+ 63us) client_negotiation.cc:240] Negotiation successful
0618 23:20:04.685094 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260618 23:20:04.685168 11977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.682596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:46667 (local address 127.3.217.129:43563)
0618 23:20:04.682648 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:04.682650 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:04.682658 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:20:04.682792 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:04.682793 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:04.682803 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:04.682877 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:04.683033 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.683522 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.684455 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.684799 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.684893 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.684902 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:04.685069 (+ 167us) server_negotiation.cc:299] Negotiation successful
0618 23:20:04.685104 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260618 23:20:04.685498 11626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe7a0bf0e1924aafa9bb767370dd3efc" candidate_uuid: "d0e911c72bde4b599396f0d97a6baf9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f2d5a64f1c441deb9b1187016982214" is_pre_election: true
I20260618 23:20:04.685647 11626 raft_consensus.cc:2454] T fe7a0bf0e1924aafa9bb767370dd3efc P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0e911c72bde4b599396f0d97a6baf9a in term 0.
I20260618 23:20:04.685880 11697 leader_election.cc:302] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f2d5a64f1c441deb9b1187016982214, d0e911c72bde4b599396f0d97a6baf9a; no voters:
I20260618 23:20:04.686092 11986 raft_consensus.cc:2781] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:20:04.686192 11986 raft_consensus.cc:482] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:20:04.686237 11986 raft_consensus.cc:3037] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:04.686378 11979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.682594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:35269 (local address 127.3.217.131:37945)
0618 23:20:04.682642 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:04.682644 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:04.682773 (+ 129us) server_negotiation.cc:407] Connection header received
0618 23:20:04.682840 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:04.682841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:04.682850 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:04.682990 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:04.683152 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.683722 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.685182 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.685830 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.685905 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.685915 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:04.686258 (+ 343us) server_negotiation.cc:299] Negotiation successful
0618 23:20:04.686302 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260618 23:20:04.686606 11989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.682521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:37945 (local address 127.3.217.130:35269)
0618 23:20:04.682692 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:04.682730 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:04.682788 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:04.682998 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:04.682998 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:04.683000 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:04.683076 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.683077 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.683918 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.683920 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.685042 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.685045 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.685924 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.685925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.686030 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.686034 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:20:04.686096 (+ 62us) client_negotiation.cc:240] Negotiation successful
0618 23:20:04.686143 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":12,"thread_start_us":104,"threads_started":1}
I20260618 23:20:04.687089 11906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe7a0bf0e1924aafa9bb767370dd3efc" candidate_uuid: "d0e911c72bde4b599396f0d97a6baf9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9be62c22063c452e9a6690890e66a8c1" is_pre_election: true
I20260618 23:20:04.687250 11906 raft_consensus.cc:2454] T fe7a0bf0e1924aafa9bb767370dd3efc P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0e911c72bde4b599396f0d97a6baf9a in term 0.
I20260618 23:20:04.687336 11986 raft_consensus.cc:504] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.687471 11986 leader_election.cc:288] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a [CANDIDATE]: Term 1 election: Requested vote from peers 4f2d5a64f1c441deb9b1187016982214 (127.3.217.129:43563), 9be62c22063c452e9a6690890e66a8c1 (127.3.217.131:37945)
I20260618 23:20:04.687620 11626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe7a0bf0e1924aafa9bb767370dd3efc" candidate_uuid: "d0e911c72bde4b599396f0d97a6baf9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f2d5a64f1c441deb9b1187016982214"
I20260618 23:20:04.687721 11626 raft_consensus.cc:3037] T fe7a0bf0e1924aafa9bb767370dd3efc P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:04.687640 11906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe7a0bf0e1924aafa9bb767370dd3efc" candidate_uuid: "d0e911c72bde4b599396f0d97a6baf9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9be62c22063c452e9a6690890e66a8c1"
I20260618 23:20:04.687816 11906 raft_consensus.cc:3037] T fe7a0bf0e1924aafa9bb767370dd3efc P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:04.688470 11626 raft_consensus.cc:2454] T fe7a0bf0e1924aafa9bb767370dd3efc P 4f2d5a64f1c441deb9b1187016982214 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0e911c72bde4b599396f0d97a6baf9a in term 1.
I20260618 23:20:04.688647 11697 leader_election.cc:302] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f2d5a64f1c441deb9b1187016982214, d0e911c72bde4b599396f0d97a6baf9a; no voters:
I20260618 23:20:04.688745 11906 raft_consensus.cc:2454] T fe7a0bf0e1924aafa9bb767370dd3efc P 9be62c22063c452e9a6690890e66a8c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0e911c72bde4b599396f0d97a6baf9a in term 1.
I20260618 23:20:04.688753 11986 raft_consensus.cc:2781] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:20:04.688930 11986 raft_consensus.cc:686] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a [term 1 LEADER]: Becoming Leader. State: Replica: d0e911c72bde4b599396f0d97a6baf9a, State: Running, Role: LEADER
I20260618 23:20:04.689033 11986 consensus_queue.cc:237] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.689872 11469 catalog_manager.cc:5495] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a reported cstate change: term changed from 0 to 1, leader changed from <none> to d0e911c72bde4b599396f0d97a6baf9a (127.3.217.130). New cstate: current_term: 1 leader_uuid: "d0e911c72bde4b599396f0d97a6baf9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } health_report { overall_health: UNKNOWN } } }
I20260618 23:20:04.702134 11978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.699689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33050 (local address 127.3.217.130:36367)
0618 23:20:04.699746 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:04.699748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:04.699787 (+ 39us) server_negotiation.cc:407] Connection header received
0618 23:20:04.699862 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:04.699862 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:04.699876 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:04.699963 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:20:04.700078 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.700531 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.701354 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.701552 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.701618 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.701792 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:20:04.701906 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:20:04.701979 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:04.702066 (+ 87us) server_negotiation.cc:299] Negotiation successful
0618 23:20:04.702084 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260618 23:20:04.704298 11906 raft_consensus.cc:1261] T fe7a0bf0e1924aafa9bb767370dd3efc P 9be62c22063c452e9a6690890e66a8c1 [term 1 FOLLOWER]: Refusing update from remote peer d0e911c72bde4b599396f0d97a6baf9a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:20:04.704416 11626 raft_consensus.cc:1261] T fe7a0bf0e1924aafa9bb767370dd3efc P 4f2d5a64f1c441deb9b1187016982214 [term 1 FOLLOWER]: Refusing update from remote peer d0e911c72bde4b599396f0d97a6baf9a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:20:04.704684 11990 consensus_queue.cc:1035] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:20:04.704823 11986 consensus_queue.cc:1035] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:20:04.707056 11993 mvcc.cc:205] Tried to move back new op lower bound from 7298354400065253376 to 7298354400006787072. Current Snapshot: MvccSnapshot[applied={T|T < 7298354400065253376}]
I20260618 23:20:04.710366 11469 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:20:04.710501 11469 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:20:04.711583 11469 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c: Sending DeleteTablet for 3 replicas of tablet fe7a0bf0e1924aafa9bb767370dd3efc
I20260618 23:20:04.711906 11606 tablet_service.cc:1514] Processing DeleteTablet for tablet fe7a0bf0e1924aafa9bb767370dd3efc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:20:04 UTC) from {username='oryx', principal='oryx/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:43710
I20260618 23:20:04.712038 11746 tablet_service.cc:1514] Processing DeleteTablet for tablet fe7a0bf0e1924aafa9bb767370dd3efc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:20:04 UTC) from {username='oryx', principal='oryx/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:33048
I20260618 23:20:04.712128 12003 tablet_replica.cc:330] T fe7a0bf0e1924aafa9bb767370dd3efc P 4f2d5a64f1c441deb9b1187016982214: stopping tablet replica
I20260618 23:20:04.712114 11886 tablet_service.cc:1514] Processing DeleteTablet for tablet fe7a0bf0e1924aafa9bb767370dd3efc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:20:04 UTC) from {username='oryx', principal='oryx/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:39114
I20260618 23:20:04.712224 12003 raft_consensus.cc:2229] T fe7a0bf0e1924aafa9bb767370dd3efc P 4f2d5a64f1c441deb9b1187016982214 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:20:04.712232 12004 tablet_replica.cc:330] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a: stopping tablet replica
I20260618 23:20:04.712297 12004 raft_consensus.cc:2229] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:20:04.712332 12003 raft_consensus.cc:2258] T fe7a0bf0e1924aafa9bb767370dd3efc P 4f2d5a64f1c441deb9b1187016982214 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:20:04.712425 12004 raft_consensus.cc:2258] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:20:04.712522 11469 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39086:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:20:04.712677 11469 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:20:04.712841 12003 ts_tablet_manager.cc:1905] T fe7a0bf0e1924aafa9bb767370dd3efc P 4f2d5a64f1c441deb9b1187016982214: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:20:04.713195 12005 tablet_replica.cc:330] T fe7a0bf0e1924aafa9bb767370dd3efc P 9be62c22063c452e9a6690890e66a8c1: stopping tablet replica
I20260618 23:20:04.713332 12005 raft_consensus.cc:2229] T fe7a0bf0e1924aafa9bb767370dd3efc P 9be62c22063c452e9a6690890e66a8c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:20:04.713498 12005 raft_consensus.cc:2258] T fe7a0bf0e1924aafa9bb767370dd3efc P 9be62c22063c452e9a6690890e66a8c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:20:04.713949 12005 ts_tablet_manager.cc:1905] T fe7a0bf0e1924aafa9bb767370dd3efc P 9be62c22063c452e9a6690890e66a8c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:20:04.714184 11886 tablet_service.cc:1467] Processing CreateTablet for tablet 7c2dfc68e9294ad6806576bc6b0eea75 (DEFAULT_TABLE table=test-table [id=36444416c922423395b300e22ee49a8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:20:04.714193 11746 tablet_service.cc:1467] Processing CreateTablet for tablet 7c2dfc68e9294ad6806576bc6b0eea75 (DEFAULT_TABLE table=test-table [id=36444416c922423395b300e22ee49a8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:20:04.714298 11746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c2dfc68e9294ad6806576bc6b0eea75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:04.714398 11886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c2dfc68e9294ad6806576bc6b0eea75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:04.715086 12003 ts_tablet_manager.cc:1918] T fe7a0bf0e1924aafa9bb767370dd3efc P 4f2d5a64f1c441deb9b1187016982214: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:20:04.715152 12003 log.cc:1196] T fe7a0bf0e1924aafa9bb767370dd3efc P 4f2d5a64f1c441deb9b1187016982214: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-0/wal/wals/fe7a0bf0e1924aafa9bb767370dd3efc
I20260618 23:20:04.715406 12003 ts_tablet_manager.cc:1939] T fe7a0bf0e1924aafa9bb767370dd3efc P 4f2d5a64f1c441deb9b1187016982214: Deleting consensus metadata
I20260618 23:20:04.715969 11982 tablet_bootstrap.cc:492] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1: Bootstrap starting.
I20260618 23:20:04.716090 12004 ts_tablet_manager.cc:1905] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:20:04.716132 11606 tablet_service.cc:1467] Processing CreateTablet for tablet 7c2dfc68e9294ad6806576bc6b0eea75 (DEFAULT_TABLE table=test-table [id=36444416c922423395b300e22ee49a8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:20:04.716228 11606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c2dfc68e9294ad6806576bc6b0eea75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:04.716434 11982 tablet_bootstrap.cc:654] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:04.716728 11453 catalog_manager.cc:4841] TS 4f2d5a64f1c441deb9b1187016982214 (127.3.217.129:43563): tablet fe7a0bf0e1924aafa9bb767370dd3efc (table test-table [id=02ed2f9d234f480bb2034007edc12fe3]) successfully deleted
I20260618 23:20:04.716924 11980 tablet_bootstrap.cc:492] T 7c2dfc68e9294ad6806576bc6b0eea75 P d0e911c72bde4b599396f0d97a6baf9a: Bootstrap starting.
I20260618 23:20:04.717311 11980 tablet_bootstrap.cc:654] T 7c2dfc68e9294ad6806576bc6b0eea75 P d0e911c72bde4b599396f0d97a6baf9a: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:04.717367 11981 tablet_bootstrap.cc:492] T 7c2dfc68e9294ad6806576bc6b0eea75 P 4f2d5a64f1c441deb9b1187016982214: Bootstrap starting.
I20260618 23:20:04.717677 12004 ts_tablet_manager.cc:1918] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:20:04.717739 12004 log.cc:1196] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/fe7a0bf0e1924aafa9bb767370dd3efc
I20260618 23:20:04.717793 11981 tablet_bootstrap.cc:654] T 7c2dfc68e9294ad6806576bc6b0eea75 P 4f2d5a64f1c441deb9b1187016982214: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:04.718003 12004 ts_tablet_manager.cc:1939] T fe7a0bf0e1924aafa9bb767370dd3efc P d0e911c72bde4b599396f0d97a6baf9a: Deleting consensus metadata
I20260618 23:20:04.718073 11982 tablet_bootstrap.cc:492] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1: No bootstrap required, opened a new log
I20260618 23:20:04.718114 11982 ts_tablet_manager.cc:1397] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:20:04.718251 11982 raft_consensus.cc:348] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.718326 11982 raft_consensus.cc:374] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:04.718353 11982 raft_consensus.cc:729] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9be62c22063c452e9a6690890e66a8c1, State: Initialized, Role: FOLLOWER
I20260618 23:20:04.718400 11982 consensus_queue.cc:260] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.718467 11455 catalog_manager.cc:4841] TS d0e911c72bde4b599396f0d97a6baf9a (127.3.217.130:36367): tablet fe7a0bf0e1924aafa9bb767370dd3efc (table test-table [id=02ed2f9d234f480bb2034007edc12fe3]) successfully deleted
I20260618 23:20:04.718488 11982 ts_tablet_manager.cc:1428] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:04.719041 11980 tablet_bootstrap.cc:492] T 7c2dfc68e9294ad6806576bc6b0eea75 P d0e911c72bde4b599396f0d97a6baf9a: No bootstrap required, opened a new log
I20260618 23:20:04.719096 11980 ts_tablet_manager.cc:1397] T 7c2dfc68e9294ad6806576bc6b0eea75 P d0e911c72bde4b599396f0d97a6baf9a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260618 23:20:04.719240 11980 raft_consensus.cc:348] T 7c2dfc68e9294ad6806576bc6b0eea75 P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.719317 11980 raft_consensus.cc:374] T 7c2dfc68e9294ad6806576bc6b0eea75 P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:04.719342 11980 raft_consensus.cc:729] T 7c2dfc68e9294ad6806576bc6b0eea75 P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0e911c72bde4b599396f0d97a6baf9a, State: Initialized, Role: FOLLOWER
I20260618 23:20:04.719422 11980 consensus_queue.cc:260] T 7c2dfc68e9294ad6806576bc6b0eea75 P d0e911c72bde4b599396f0d97a6baf9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.719522 11980 ts_tablet_manager.cc:1428] T 7c2dfc68e9294ad6806576bc6b0eea75 P d0e911c72bde4b599396f0d97a6baf9a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:04.720183 12005 ts_tablet_manager.cc:1918] T fe7a0bf0e1924aafa9bb767370dd3efc P 9be62c22063c452e9a6690890e66a8c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:20:04.720259 12005 log.cc:1196] T fe7a0bf0e1924aafa9bb767370dd3efc P 9be62c22063c452e9a6690890e66a8c1: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/fe7a0bf0e1924aafa9bb767370dd3efc
I20260618 23:20:04.720521 12005 ts_tablet_manager.cc:1939] T fe7a0bf0e1924aafa9bb767370dd3efc P 9be62c22063c452e9a6690890e66a8c1: Deleting consensus metadata
I20260618 23:20:04.721064 11981 tablet_bootstrap.cc:492] T 7c2dfc68e9294ad6806576bc6b0eea75 P 4f2d5a64f1c441deb9b1187016982214: No bootstrap required, opened a new log
I20260618 23:20:04.721115 11981 ts_tablet_manager.cc:1397] T 7c2dfc68e9294ad6806576bc6b0eea75 P 4f2d5a64f1c441deb9b1187016982214: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260618 23:20:04.721248 11981 raft_consensus.cc:348] T 7c2dfc68e9294ad6806576bc6b0eea75 P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.721315 11981 raft_consensus.cc:374] T 7c2dfc68e9294ad6806576bc6b0eea75 P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:04.721335 11981 raft_consensus.cc:729] T 7c2dfc68e9294ad6806576bc6b0eea75 P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f2d5a64f1c441deb9b1187016982214, State: Initialized, Role: FOLLOWER
I20260618 23:20:04.721382 11981 consensus_queue.cc:260] T 7c2dfc68e9294ad6806576bc6b0eea75 P 4f2d5a64f1c441deb9b1187016982214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.721459 11981 ts_tablet_manager.cc:1428] T 7c2dfc68e9294ad6806576bc6b0eea75 P 4f2d5a64f1c441deb9b1187016982214: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:04.721617 11456 catalog_manager.cc:4841] TS 9be62c22063c452e9a6690890e66a8c1 (127.3.217.131:37945): tablet fe7a0bf0e1924aafa9bb767370dd3efc (table test-table [id=02ed2f9d234f480bb2034007edc12fe3]) successfully deleted
W20260618 23:20:04.765228 11673 tablet.cc:2369] T 7c2dfc68e9294ad6806576bc6b0eea75 P 4f2d5a64f1c441deb9b1187016982214: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260618 23:20:04.841195 11953 tablet.cc:2369] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 23:20:04.920517 11987 raft_consensus.cc:482] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:20:04.920631 11987 raft_consensus.cc:504] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.920996 11987 leader_election.cc:288] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f2d5a64f1c441deb9b1187016982214 (127.3.217.129:43563), d0e911c72bde4b599396f0d97a6baf9a (127.3.217.130:36367)
I20260618 23:20:04.924472 11978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.921256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:44795 (local address 127.3.217.130:36367)
0618 23:20:04.921320 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:04.921323 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:04.921333 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:20:04.921406 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:04.921407 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:04.921422 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:04.921485 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:04.921895 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.922453 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.923643 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.924067 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.924132 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.924139 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:04.924359 (+ 220us) server_negotiation.cc:299] Negotiation successful
0618 23:20:04.924395 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260618 23:20:04.924528 11845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.921197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:36367 (local address 127.3.217.131:44795)
0618 23:20:04.921253 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:04.921265 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:04.921320 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:04.921628 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:04.921631 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:04.921635 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:04.921765 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.921768 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.922537 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.922539 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.923541 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.923544 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.924170 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.924172 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.924272 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.924277 (+ 5us) client_negotiation.cc:769] Sending connection context
0618 23:20:04.924354 (+ 77us) client_negotiation.cc:240] Negotiation successful
0618 23:20:04.924410 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260618 23:20:04.924813 11977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.921373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:47577 (local address 127.3.217.129:43563)
0618 23:20:04.921446 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:04.921448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:04.921609 (+ 161us) server_negotiation.cc:407] Connection header received
0618 23:20:04.921659 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:04.921661 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:04.921676 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:04.921795 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:04.922121 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.922693 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.923859 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.924441 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.924517 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.924526 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:04.924703 (+ 177us) server_negotiation.cc:299] Negotiation successful
0618 23:20:04.924746 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260618 23:20:04.924855 11766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c2dfc68e9294ad6806576bc6b0eea75" candidate_uuid: "9be62c22063c452e9a6690890e66a8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0e911c72bde4b599396f0d97a6baf9a" is_pre_election: true
I20260618 23:20:04.925050 11766 raft_consensus.cc:2454] T 7c2dfc68e9294ad6806576bc6b0eea75 P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9be62c22063c452e9a6690890e66a8c1 in term 0.
I20260618 23:20:04.925079 12009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.921249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:43563 (local address 127.3.217.131:47577)
0618 23:20:04.921392 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:04.921402 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:04.921444 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:04.921872 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:04.921873 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:04.921877 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:04.921978 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.921993 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.922823 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.922823 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.923737 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.923739 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.924527 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.924528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.924607 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.924612 (+ 5us) client_negotiation.cc:769] Sending connection context
0618 23:20:04.924916 (+ 304us) client_negotiation.cc:240] Negotiation successful
0618 23:20:04.925000 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":69,"threads_started":1}
I20260618 23:20:04.925310 11626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c2dfc68e9294ad6806576bc6b0eea75" candidate_uuid: "9be62c22063c452e9a6690890e66a8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f2d5a64f1c441deb9b1187016982214" is_pre_election: true
I20260618 23:20:04.925335 11839 leader_election.cc:302] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9be62c22063c452e9a6690890e66a8c1, d0e911c72bde4b599396f0d97a6baf9a; no voters:
I20260618 23:20:04.925414 11626 raft_consensus.cc:2454] T 7c2dfc68e9294ad6806576bc6b0eea75 P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9be62c22063c452e9a6690890e66a8c1 in term 0.
I20260618 23:20:04.925464 11987 raft_consensus.cc:2781] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:20:04.925534 11987 raft_consensus.cc:482] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:20:04.925565 11987 raft_consensus.cc:3037] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:04.926303 11987 raft_consensus.cc:504] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.926460 11987 leader_election.cc:288] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1 [CANDIDATE]: Term 1 election: Requested vote from peers 4f2d5a64f1c441deb9b1187016982214 (127.3.217.129:43563), d0e911c72bde4b599396f0d97a6baf9a (127.3.217.130:36367)
I20260618 23:20:04.926685 11766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c2dfc68e9294ad6806576bc6b0eea75" candidate_uuid: "9be62c22063c452e9a6690890e66a8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0e911c72bde4b599396f0d97a6baf9a"
I20260618 23:20:04.926784 11766 raft_consensus.cc:3037] T 7c2dfc68e9294ad6806576bc6b0eea75 P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:04.926741 11626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c2dfc68e9294ad6806576bc6b0eea75" candidate_uuid: "9be62c22063c452e9a6690890e66a8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f2d5a64f1c441deb9b1187016982214"
I20260618 23:20:04.926893 11626 raft_consensus.cc:3037] T 7c2dfc68e9294ad6806576bc6b0eea75 P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:04.927582 11766 raft_consensus.cc:2454] T 7c2dfc68e9294ad6806576bc6b0eea75 P d0e911c72bde4b599396f0d97a6baf9a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9be62c22063c452e9a6690890e66a8c1 in term 1.
I20260618 23:20:04.927747 11839 leader_election.cc:302] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9be62c22063c452e9a6690890e66a8c1, d0e911c72bde4b599396f0d97a6baf9a; no voters:
I20260618 23:20:04.927809 11626 raft_consensus.cc:2454] T 7c2dfc68e9294ad6806576bc6b0eea75 P 4f2d5a64f1c441deb9b1187016982214 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9be62c22063c452e9a6690890e66a8c1 in term 1.
I20260618 23:20:04.927837 11987 raft_consensus.cc:2781] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:20:04.927997 11987 raft_consensus.cc:686] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9be62c22063c452e9a6690890e66a8c1, State: Running, Role: LEADER
I20260618 23:20:04.928071 11987 consensus_queue.cc:237] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.928831 11468 catalog_manager.cc:5495] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9be62c22063c452e9a6690890e66a8c1 (127.3.217.131). New cstate: current_term: 1 leader_uuid: "9be62c22063c452e9a6690890e66a8c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } health_report { overall_health: HEALTHY } } }
Jun 18 23:20:04 dist-test-slave-r9ct krb5kdc[11424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824804, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.190@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM
I20260618 23:20:04.971138 11518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.963738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39092 (local address 127.3.217.190:38697)
0618 23:20:04.963897 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:04.963901 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:04.963920 (+ 19us) server_negotiation.cc:407] Connection header received
0618 23:20:04.963991 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:04.963992 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:04.964006 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:04.964091 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:04.964567 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.965047 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.965747 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.965931 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.965988 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.968362 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:04.968363 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:04.968363 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:04.968369 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:04.969734 (+ 1365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:04.970112 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:04.970120 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:04.970120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:04.970171 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:04.970341 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:04.970342 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:04.970342 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:04.970440 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:04.970526 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:04.970987 (+ 461us) server_negotiation.cc:299] Negotiation successful
0618 23:20:04.971071 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":121}
I20260618 23:20:04.971240 12017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:04.963611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:38697 (local address 127.0.0.1:39092)
0618 23:20:04.963843 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:04.963856 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:04.963923 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:04.964107 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:04.964108 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:04.964393 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:04.964446 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.964448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.965138 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.965139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.965665 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:04.965667 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:04.966045 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:04.966046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:04.966122 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:04.966897 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:04.966902 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:04.968288 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:04.969809 (+ 1521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:04.969815 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:04.969817 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:04.970006 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:04.970232 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:04.970233 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:04.970233 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:04.970287 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:04.970561 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:04.970568 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:04.970629 (+ 61us) client_negotiation.cc:769] Sending connection context
0618 23:20:04.970941 (+ 312us) client_negotiation.cc:240] Negotiation successful
0618 23:20:04.971145 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"mutex_wait_us":76,"thread_start_us":113,"threads_started":1}
I20260618 23:20:04.973675 11468 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:39092:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260618 23:20:04.973908 11468 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:20:04.975366 11606 tablet_service.cc:1467] Processing CreateTablet for tablet 187bb3922bf848e2927032a92a5645ee (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5b8bbfee12cd466ba4f3978a2b1490f6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260618 23:20:04.975383 11746 tablet_service.cc:1467] Processing CreateTablet for tablet 187bb3922bf848e2927032a92a5645ee (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5b8bbfee12cd466ba4f3978a2b1490f6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260618 23:20:04.975419 11886 tablet_service.cc:1467] Processing CreateTablet for tablet 187bb3922bf848e2927032a92a5645ee (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5b8bbfee12cd466ba4f3978a2b1490f6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260618 23:20:04.975524 11746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 187bb3922bf848e2927032a92a5645ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:04.975524 11606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 187bb3922bf848e2927032a92a5645ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:04.975580 11886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 187bb3922bf848e2927032a92a5645ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:04.976928 11980 tablet_bootstrap.cc:492] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a: Bootstrap starting.
I20260618 23:20:04.976944 11981 tablet_bootstrap.cc:492] T 187bb3922bf848e2927032a92a5645ee P 4f2d5a64f1c441deb9b1187016982214: Bootstrap starting.
I20260618 23:20:04.977000 11982 tablet_bootstrap.cc:492] T 187bb3922bf848e2927032a92a5645ee P 9be62c22063c452e9a6690890e66a8c1: Bootstrap starting.
I20260618 23:20:04.977308 11981 tablet_bootstrap.cc:654] T 187bb3922bf848e2927032a92a5645ee P 4f2d5a64f1c441deb9b1187016982214: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:04.977308 11980 tablet_bootstrap.cc:654] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:04.977383 11982 tablet_bootstrap.cc:654] T 187bb3922bf848e2927032a92a5645ee P 9be62c22063c452e9a6690890e66a8c1: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:04.977946 11981 tablet_bootstrap.cc:492] T 187bb3922bf848e2927032a92a5645ee P 4f2d5a64f1c441deb9b1187016982214: No bootstrap required, opened a new log
I20260618 23:20:04.977996 11981 ts_tablet_manager.cc:1397] T 187bb3922bf848e2927032a92a5645ee P 4f2d5a64f1c441deb9b1187016982214: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:04.978084 11982 tablet_bootstrap.cc:492] T 187bb3922bf848e2927032a92a5645ee P 9be62c22063c452e9a6690890e66a8c1: No bootstrap required, opened a new log
I20260618 23:20:04.978099 11980 tablet_bootstrap.cc:492] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a: No bootstrap required, opened a new log
I20260618 23:20:04.978156 11980 ts_tablet_manager.cc:1397] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260618 23:20:04.978157 11982 ts_tablet_manager.cc:1397] T 187bb3922bf848e2927032a92a5645ee P 9be62c22063c452e9a6690890e66a8c1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:04.978147 11981 raft_consensus.cc:348] T 187bb3922bf848e2927032a92a5645ee P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.978223 11981 raft_consensus.cc:374] T 187bb3922bf848e2927032a92a5645ee P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:04.978248 11981 raft_consensus.cc:729] T 187bb3922bf848e2927032a92a5645ee P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f2d5a64f1c441deb9b1187016982214, State: Initialized, Role: FOLLOWER
I20260618 23:20:04.978256 11980 raft_consensus.cc:348] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.978294 11981 consensus_queue.cc:260] T 187bb3922bf848e2927032a92a5645ee P 4f2d5a64f1c441deb9b1187016982214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.978329 11980 raft_consensus.cc:374] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:04.978313 11982 raft_consensus.cc:348] T 187bb3922bf848e2927032a92a5645ee P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.978359 11980 raft_consensus.cc:729] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0e911c72bde4b599396f0d97a6baf9a, State: Initialized, Role: FOLLOWER
I20260618 23:20:04.978379 11982 raft_consensus.cc:374] T 187bb3922bf848e2927032a92a5645ee P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:04.978389 11981 ts_tablet_manager.cc:1428] T 187bb3922bf848e2927032a92a5645ee P 4f2d5a64f1c441deb9b1187016982214: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260618 23:20:04.978407 11982 raft_consensus.cc:729] T 187bb3922bf848e2927032a92a5645ee P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9be62c22063c452e9a6690890e66a8c1, State: Initialized, Role: FOLLOWER
I20260618 23:20:04.978397 11980 consensus_queue.cc:260] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.978454 11982 consensus_queue.cc:260] T 187bb3922bf848e2927032a92a5645ee P 9be62c22063c452e9a6690890e66a8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:04.978504 11980 ts_tablet_manager.cc:1428] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:04.978497 11988 tablet_replica.cc:439] T 187bb3922bf848e2927032a92a5645ee P 4f2d5a64f1c441deb9b1187016982214: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } } }
I20260618 23:20:04.978557 11982 ts_tablet_manager.cc:1428] T 187bb3922bf848e2927032a92a5645ee P 9be62c22063c452e9a6690890e66a8c1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260618 23:20:04.978582 11988 tablet_replica.cc:442] T 187bb3922bf848e2927032a92a5645ee P 4f2d5a64f1c441deb9b1187016982214: This TxnStatusTablet replica's current role is: FOLLOWER
I20260618 23:20:04.978654 12000 tablet_replica.cc:439] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } } }
I20260618 23:20:04.978777 12000 tablet_replica.cc:442] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260618 23:20:04.978888 11987 tablet_replica.cc:439] T 187bb3922bf848e2927032a92a5645ee P 9be62c22063c452e9a6690890e66a8c1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } } }
I20260618 23:20:04.978966 11987 tablet_replica.cc:442] T 187bb3922bf848e2927032a92a5645ee P 9be62c22063c452e9a6690890e66a8c1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260618 23:20:05.039278 12000 raft_consensus.cc:482] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:20:05.039381 12000 raft_consensus.cc:504] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:05.039583 12000 leader_election.cc:288] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f2d5a64f1c441deb9b1187016982214 (127.3.217.129:43563), 9be62c22063c452e9a6690890e66a8c1 (127.3.217.131:37945)
I20260618 23:20:05.039790 11906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "187bb3922bf848e2927032a92a5645ee" candidate_uuid: "d0e911c72bde4b599396f0d97a6baf9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9be62c22063c452e9a6690890e66a8c1" is_pre_election: true
I20260618 23:20:05.039794 11626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "187bb3922bf848e2927032a92a5645ee" candidate_uuid: "d0e911c72bde4b599396f0d97a6baf9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f2d5a64f1c441deb9b1187016982214" is_pre_election: true
I20260618 23:20:05.039939 11906 raft_consensus.cc:2454] T 187bb3922bf848e2927032a92a5645ee P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0e911c72bde4b599396f0d97a6baf9a in term 0.
I20260618 23:20:05.039896 11626 raft_consensus.cc:2454] T 187bb3922bf848e2927032a92a5645ee P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0e911c72bde4b599396f0d97a6baf9a in term 0.
I20260618 23:20:05.040131 11700 leader_election.cc:302] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9be62c22063c452e9a6690890e66a8c1, d0e911c72bde4b599396f0d97a6baf9a; no voters:
I20260618 23:20:05.040210 12000 raft_consensus.cc:2781] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:20:05.040252 12000 raft_consensus.cc:482] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:20:05.040285 12000 raft_consensus.cc:3037] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:05.041177 12000 raft_consensus.cc:504] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:05.041311 12000 leader_election.cc:288] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a [CANDIDATE]: Term 1 election: Requested vote from peers 4f2d5a64f1c441deb9b1187016982214 (127.3.217.129:43563), 9be62c22063c452e9a6690890e66a8c1 (127.3.217.131:37945)
I20260618 23:20:05.041512 11906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "187bb3922bf848e2927032a92a5645ee" candidate_uuid: "d0e911c72bde4b599396f0d97a6baf9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9be62c22063c452e9a6690890e66a8c1"
I20260618 23:20:05.041599 11906 raft_consensus.cc:3037] T 187bb3922bf848e2927032a92a5645ee P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:05.041741 11626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "187bb3922bf848e2927032a92a5645ee" candidate_uuid: "d0e911c72bde4b599396f0d97a6baf9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f2d5a64f1c441deb9b1187016982214"
I20260618 23:20:05.041921 11626 raft_consensus.cc:3037] T 187bb3922bf848e2927032a92a5645ee P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:05.042557 11626 raft_consensus.cc:2454] T 187bb3922bf848e2927032a92a5645ee P 4f2d5a64f1c441deb9b1187016982214 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0e911c72bde4b599396f0d97a6baf9a in term 1.
I20260618 23:20:05.042701 11906 raft_consensus.cc:2454] T 187bb3922bf848e2927032a92a5645ee P 9be62c22063c452e9a6690890e66a8c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0e911c72bde4b599396f0d97a6baf9a in term 1.
I20260618 23:20:05.042766 11697 leader_election.cc:302] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f2d5a64f1c441deb9b1187016982214, d0e911c72bde4b599396f0d97a6baf9a; no voters:
I20260618 23:20:05.042924 12000 raft_consensus.cc:2781] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:20:05.042984 12000 raft_consensus.cc:686] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a [term 1 LEADER]: Becoming Leader. State: Replica: d0e911c72bde4b599396f0d97a6baf9a, State: Running, Role: LEADER
I20260618 23:20:05.043023 12000 consensus_queue.cc:237] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:05.043241 11990 tablet_replica.cc:439] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a: TxnStatusTablet state changed. Reason: New leader d0e911c72bde4b599396f0d97a6baf9a. Latest consensus state: current_term: 1 leader_uuid: "d0e911c72bde4b599396f0d97a6baf9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } } }
I20260618 23:20:05.043303 11990 tablet_replica.cc:442] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a: This TxnStatusTablet replica's current role is: LEADER
I20260618 23:20:05.043488 12022 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260618 23:20:05.043577 12022 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260618 23:20:05.043658 11468 catalog_manager.cc:5495] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a reported cstate change: term changed from 0 to 1, leader changed from <none> to d0e911c72bde4b599396f0d97a6baf9a (127.3.217.130). New cstate: current_term: 1 leader_uuid: "d0e911c72bde4b599396f0d97a6baf9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } health_report { overall_health: UNKNOWN } } }
I20260618 23:20:05.056322 11978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:05.053243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33066 (local address 127.3.217.130:36367)
0618 23:20:05.053280 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:05.053282 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:05.053323 (+ 41us) server_negotiation.cc:407] Connection header received
0618 23:20:05.053410 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:05.053411 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:05.053419 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:05.053459 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:20:05.053644 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:05.054198 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:05.055511 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:05.055690 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:05.055751 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:05.056003 (+ 252us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:20:05.056111 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:20:05.056162 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:05.056252 (+ 90us) server_negotiation.cc:299] Negotiation successful
0618 23:20:05.056269 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260618 23:20:05.056370 12017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:05.053204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:36367 (local address 127.0.0.1:33066)
0618 23:20:05.053280 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:05.053291 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:05.053340 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:05.053491 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:05.053492 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:05.053493 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0618 23:20:05.053539 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:05.053541 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:05.054308 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:05.054308 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:05.055406 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:05.055409 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:05.055767 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:05.055767 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:05.055830 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:05.055845 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0618 23:20:05.056183 (+ 338us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0618 23:20:05.056190 (+ 7us) client_negotiation.cc:769] Sending connection context
0618 23:20:05.056247 (+ 57us) client_negotiation.cc:240] Negotiation successful
0618 23:20:05.056293 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260618 23:20:05.057499 11626 raft_consensus.cc:1261] T 187bb3922bf848e2927032a92a5645ee P 4f2d5a64f1c441deb9b1187016982214 [term 1 FOLLOWER]: Refusing update from remote peer d0e911c72bde4b599396f0d97a6baf9a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:20:05.057561 11906 raft_consensus.cc:1261] T 187bb3922bf848e2927032a92a5645ee P 9be62c22063c452e9a6690890e66a8c1 [term 1 FOLLOWER]: Refusing update from remote peer d0e911c72bde4b599396f0d97a6baf9a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:20:05.057718 11990 consensus_queue.cc:1035] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:20:05.057818 12000 consensus_queue.cc:1035] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:20:05.058257 11987 tablet_replica.cc:439] T 187bb3922bf848e2927032a92a5645ee P 9be62c22063c452e9a6690890e66a8c1: TxnStatusTablet state changed. Reason: New leader d0e911c72bde4b599396f0d97a6baf9a. Latest consensus state: current_term: 1 leader_uuid: "d0e911c72bde4b599396f0d97a6baf9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } } }
I20260618 23:20:05.058343 11987 tablet_replica.cc:442] T 187bb3922bf848e2927032a92a5645ee P 9be62c22063c452e9a6690890e66a8c1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260618 23:20:05.058303 11988 tablet_replica.cc:439] T 187bb3922bf848e2927032a92a5645ee P 4f2d5a64f1c441deb9b1187016982214: TxnStatusTablet state changed. Reason: New leader d0e911c72bde4b599396f0d97a6baf9a. Latest consensus state: current_term: 1 leader_uuid: "d0e911c72bde4b599396f0d97a6baf9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } } }
I20260618 23:20:05.058374 11988 tablet_replica.cc:442] T 187bb3922bf848e2927032a92a5645ee P 4f2d5a64f1c441deb9b1187016982214: This TxnStatusTablet replica's current role is: FOLLOWER
I20260618 23:20:05.059072 11990 tablet_replica.cc:439] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d0e911c72bde4b599396f0d97a6baf9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } } }
I20260618 23:20:05.059156 11990 tablet_replica.cc:442] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a: This TxnStatusTablet replica's current role is: LEADER
I20260618 23:20:05.059193 11986 tablet_replica.cc:439] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d0e911c72bde4b599396f0d97a6baf9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } } }
I20260618 23:20:05.059253 11986 tablet_replica.cc:442] T 187bb3922bf848e2927032a92a5645ee P d0e911c72bde4b599396f0d97a6baf9a: This TxnStatusTablet replica's current role is: LEADER
I20260618 23:20:05.059285 11994 mvcc.cc:205] Tried to move back new op lower bound from 7298354401513996288 to 7298354401456586752. Current Snapshot: MvccSnapshot[applied={T|T < 7298354401513996288}]
I20260618 23:20:05.059388 11987 tablet_replica.cc:439] T 187bb3922bf848e2927032a92a5645ee P 9be62c22063c452e9a6690890e66a8c1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d0e911c72bde4b599396f0d97a6baf9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } } }
I20260618 23:20:05.059454 11987 tablet_replica.cc:442] T 187bb3922bf848e2927032a92a5645ee P 9be62c22063c452e9a6690890e66a8c1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260618 23:20:05.059554 11995 mvcc.cc:205] Tried to move back new op lower bound from 7298354401513996288 to 7298354401456586752. Current Snapshot: MvccSnapshot[applied={T|T < 7298354401513996288 or (T in {7298354401513996288})}]
I20260618 23:20:05.060117 11988 tablet_replica.cc:439] T 187bb3922bf848e2927032a92a5645ee P 4f2d5a64f1c441deb9b1187016982214: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d0e911c72bde4b599396f0d97a6baf9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } } }
I20260618 23:20:05.060197 11988 tablet_replica.cc:442] T 187bb3922bf848e2927032a92a5645ee P 4f2d5a64f1c441deb9b1187016982214: This TxnStatusTablet replica's current role is: FOLLOWER
I20260618 23:20:05.063149 11979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:05.060546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39120 (local address 127.3.217.131:37945)
0618 23:20:05.060585 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:05.060587 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:05.060595 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:20:05.060677 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:05.060678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:05.060694 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:05.060757 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:20:05.060852 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:05.061598 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:05.062303 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:05.062596 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:05.062664 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:05.062835 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:20:05.062960 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:20:05.063030 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:05.063064 (+ 34us) server_negotiation.cc:299] Negotiation successful
0618 23:20:05.063082 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260618 23:20:05.069561 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:05.066081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:36367 (local address 127.3.217.131:38403)
0618 23:20:05.066242 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:05.066256 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:05.066351 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:05.066515 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:05.066516 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:05.066517 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0618 23:20:05.066589 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:05.066591 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:05.067421 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:05.067422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:05.068589 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:05.068593 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:05.069029 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:05.069030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:05.069113 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:05.069131 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0618 23:20:05.069374 (+ 243us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0618 23:20:05.069376 (+ 2us) client_negotiation.cc:769] Sending connection context
0618 23:20:05.069422 (+ 46us) client_negotiation.cc:240] Negotiation successful
0618 23:20:05.069473 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116}
I20260618 23:20:05.069854 11978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:05.066159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:38403 (local address 127.3.217.130:36367)
0618 23:20:05.066231 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:05.066233 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:05.066360 (+ 127us) server_negotiation.cc:407] Connection header received
0618 23:20:05.066420 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:05.066421 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:05.066434 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:05.066498 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:20:05.066775 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:05.067309 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:05.068704 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:05.068919 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:05.068985 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:05.069269 (+ 284us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:20:05.069297 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:20:05.069355 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:05.069693 (+ 338us) server_negotiation.cc:299] Negotiation successful
0618 23:20:05.069787 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260618 23:20:05.072218 11626 raft_consensus.cc:1261] T 7c2dfc68e9294ad6806576bc6b0eea75 P 4f2d5a64f1c441deb9b1187016982214 [term 1 FOLLOWER]: Refusing update from remote peer 9be62c22063c452e9a6690890e66a8c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:20:05.072319 11766 raft_consensus.cc:1261] T 7c2dfc68e9294ad6806576bc6b0eea75 P d0e911c72bde4b599396f0d97a6baf9a [term 1 FOLLOWER]: Refusing update from remote peer 9be62c22063c452e9a6690890e66a8c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:20:05.072599 11987 consensus_queue.cc:1035] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:20:05.072742 12010 consensus_queue.cc:1035] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:20:05.082017 11979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:05.079238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:43837 (local address 127.3.217.131:37945)
0618 23:20:05.079276 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:05.079278 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:05.079464 (+ 186us) server_negotiation.cc:407] Connection header received
0618 23:20:05.079492 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:05.079492 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:05.079503 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:05.079567 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:20:05.079887 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:05.080505 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:05.081262 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:05.081473 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:05.081560 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:05.081729 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:20:05.081760 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:20:05.081811 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:05.081916 (+ 105us) server_negotiation.cc:299] Negotiation successful
0618 23:20:05.081939 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260618 23:20:05.082026 12032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:05.079161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:37945 (local address 127.3.217.130:43837)
0618 23:20:05.079379 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:05.079388 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:05.079451 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:05.079577 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:05.079578 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:05.079579 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0618 23:20:05.079779 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:05.079781 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:05.080588 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:05.080589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:05.081177 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:05.081179 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:05.081562 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:05.081563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:05.081620 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:05.081633 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0618 23:20:05.081836 (+ 203us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0618 23:20:05.081838 (+ 2us) client_negotiation.cc:769] Sending connection context
0618 23:20:05.081900 (+ 62us) client_negotiation.cc:240] Negotiation successful
0618 23:20:05.081943 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":165,"threads_started":1}
I20260618 23:20:05.089881 11469 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:20:05.089987 11469 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:20:05.090552 11469 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c: Sending DeleteTablet for 3 replicas of tablet 7c2dfc68e9294ad6806576bc6b0eea75
I20260618 23:20:05.090788 11746 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c2dfc68e9294ad6806576bc6b0eea75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:20:05 UTC) from {username='oryx', principal='oryx/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:33048
I20260618 23:20:05.090881 12004 tablet_replica.cc:330] T 7c2dfc68e9294ad6806576bc6b0eea75 P d0e911c72bde4b599396f0d97a6baf9a: stopping tablet replica
I20260618 23:20:05.090909 11606 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c2dfc68e9294ad6806576bc6b0eea75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:20:05 UTC) from {username='oryx', principal='oryx/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:43710
I20260618 23:20:05.090939 12004 raft_consensus.cc:2229] T 7c2dfc68e9294ad6806576bc6b0eea75 P d0e911c72bde4b599396f0d97a6baf9a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:20:05.090950 11886 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c2dfc68e9294ad6806576bc6b0eea75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:20:05 UTC) from {username='oryx', principal='oryx/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:39114
I20260618 23:20:05.090977 12004 raft_consensus.cc:2258] T 7c2dfc68e9294ad6806576bc6b0eea75 P d0e911c72bde4b599396f0d97a6baf9a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:20:05.091012 12003 tablet_replica.cc:330] T 7c2dfc68e9294ad6806576bc6b0eea75 P 4f2d5a64f1c441deb9b1187016982214: stopping tablet replica
I20260618 23:20:05.091043 12005 tablet_replica.cc:330] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1: stopping tablet replica
I20260618 23:20:05.091063 12003 raft_consensus.cc:2229] T 7c2dfc68e9294ad6806576bc6b0eea75 P 4f2d5a64f1c441deb9b1187016982214 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:20:05.091096 12003 raft_consensus.cc:2258] T 7c2dfc68e9294ad6806576bc6b0eea75 P 4f2d5a64f1c441deb9b1187016982214 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:20:05.091099 12005 raft_consensus.cc:2229] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1 [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:20:05.091184 12005 raft_consensus.cc:2258] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:20:05.091298 12004 ts_tablet_manager.cc:1905] T 7c2dfc68e9294ad6806576bc6b0eea75 P d0e911c72bde4b599396f0d97a6baf9a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:20:05.091364 12003 ts_tablet_manager.cc:1905] T 7c2dfc68e9294ad6806576bc6b0eea75 P 4f2d5a64f1c441deb9b1187016982214: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:20:05.091521 12005 ts_tablet_manager.cc:1905] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:20:05.092900 12004 ts_tablet_manager.cc:1918] T 7c2dfc68e9294ad6806576bc6b0eea75 P d0e911c72bde4b599396f0d97a6baf9a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260618 23:20:05.092896 12003 ts_tablet_manager.cc:1918] T 7c2dfc68e9294ad6806576bc6b0eea75 P 4f2d5a64f1c441deb9b1187016982214: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260618 23:20:05.092952 12003 log.cc:1196] T 7c2dfc68e9294ad6806576bc6b0eea75 P 4f2d5a64f1c441deb9b1187016982214: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-0/wal/wals/7c2dfc68e9294ad6806576bc6b0eea75
I20260618 23:20:05.092952 12004 log.cc:1196] T 7c2dfc68e9294ad6806576bc6b0eea75 P d0e911c72bde4b599396f0d97a6baf9a: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/7c2dfc68e9294ad6806576bc6b0eea75
I20260618 23:20:05.093067 12005 ts_tablet_manager.cc:1918] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260618 23:20:05.093116 12005 log.cc:1196] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/7c2dfc68e9294ad6806576bc6b0eea75
I20260618 23:20:05.093175 12003 ts_tablet_manager.cc:1939] T 7c2dfc68e9294ad6806576bc6b0eea75 P 4f2d5a64f1c441deb9b1187016982214: Deleting consensus metadata
I20260618 23:20:05.093175 12004 ts_tablet_manager.cc:1939] T 7c2dfc68e9294ad6806576bc6b0eea75 P d0e911c72bde4b599396f0d97a6baf9a: Deleting consensus metadata
I20260618 23:20:05.093333 12005 ts_tablet_manager.cc:1939] T 7c2dfc68e9294ad6806576bc6b0eea75 P 9be62c22063c452e9a6690890e66a8c1: Deleting consensus metadata
I20260618 23:20:05.093453 11453 catalog_manager.cc:4841] TS 4f2d5a64f1c441deb9b1187016982214 (127.3.217.129:43563): tablet 7c2dfc68e9294ad6806576bc6b0eea75 (table test-table [id=36444416c922423395b300e22ee49a8b]) successfully deleted
I20260618 23:20:05.093653 11456 catalog_manager.cc:4841] TS 9be62c22063c452e9a6690890e66a8c1 (127.3.217.131:37945): tablet 7c2dfc68e9294ad6806576bc6b0eea75 (table test-table [id=36444416c922423395b300e22ee49a8b]) successfully deleted
I20260618 23:20:05.093469 11455 catalog_manager.cc:4841] TS d0e911c72bde4b599396f0d97a6baf9a (127.3.217.130:36367): tablet 7c2dfc68e9294ad6806576bc6b0eea75 (table test-table [id=36444416c922423395b300e22ee49a8b]) successfully deleted
Jun 18 23:20:05 dist-test-slave-r9ct krb5kdc[11424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 18 23:20:05 dist-test-slave-r9ct krb5kdc[11424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:05 dist-test-slave-r9ct krb5kdc[11424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
W20260618 23:20:05.121790 11518 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:05.114859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39096 (local address 127.3.217.190:38697)
0618 23:20:05.114914 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:05.114916 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:05.115107 (+ 191us) server_negotiation.cc:407] Connection header received
0618 23:20:05.115144 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:05.115145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:05.115157 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:05.115235 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:05.115971 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:05.116776 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:05.117865 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:05.118194 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:05.118267 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:05.121725 (+ 3458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39096: BlockingRecv error: recv got EOF from 127.0.0.1:39096 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Jun 18 23:20:05 dist-test-slave-r9ct krb5kdc[11424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM
I20260618 23:20:05.133193 11518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:05.123578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39108 (local address 127.3.217.190:38697)
0618 23:20:05.123618 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:05.123620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:05.123743 (+ 123us) server_negotiation.cc:407] Connection header received
0618 23:20:05.123793 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:05.123794 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:05.123804 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:05.123880 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:05.124426 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:05.125292 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:05.126347 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:05.126670 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:05.126836 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:05.129810 (+ 2974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:05.129812 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:05.129812 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:05.129829 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:05.131855 (+ 2026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:05.132279 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:05.132280 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:05.132281 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:05.132341 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:05.132550 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:05.132551 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:05.132551 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:05.132683 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:05.132784 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:05.132923 (+ 139us) server_negotiation.cc:299] Negotiation successful
0618 23:20:05.133003 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260618 23:20:05.135242 11469 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39108:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:20:05.135403 11469 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:20:05.136845 11606 tablet_service.cc:1467] Processing CreateTablet for tablet e35b2734915447fc8a9238debf65409b (DEFAULT_TABLE table=test-table [id=fd5ef4db03e840e2a904b7d364fb5cb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:20:05.136983 11606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e35b2734915447fc8a9238debf65409b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:05.136952 11746 tablet_service.cc:1467] Processing CreateTablet for tablet e35b2734915447fc8a9238debf65409b (DEFAULT_TABLE table=test-table [id=fd5ef4db03e840e2a904b7d364fb5cb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:20:05.137075 11746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e35b2734915447fc8a9238debf65409b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:05.138314 11981 tablet_bootstrap.cc:492] T e35b2734915447fc8a9238debf65409b P 4f2d5a64f1c441deb9b1187016982214: Bootstrap starting.
I20260618 23:20:05.138326 11886 tablet_service.cc:1467] Processing CreateTablet for tablet e35b2734915447fc8a9238debf65409b (DEFAULT_TABLE table=test-table [id=fd5ef4db03e840e2a904b7d364fb5cb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:20:05.138435 11886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e35b2734915447fc8a9238debf65409b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:05.138775 11981 tablet_bootstrap.cc:654] T e35b2734915447fc8a9238debf65409b P 4f2d5a64f1c441deb9b1187016982214: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:05.139546 11981 tablet_bootstrap.cc:492] T e35b2734915447fc8a9238debf65409b P 4f2d5a64f1c441deb9b1187016982214: No bootstrap required, opened a new log
I20260618 23:20:05.139593 11981 ts_tablet_manager.cc:1397] T e35b2734915447fc8a9238debf65409b P 4f2d5a64f1c441deb9b1187016982214: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260618 23:20:05.139737 11981 raft_consensus.cc:348] T e35b2734915447fc8a9238debf65409b P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:05.139775 11980 tablet_bootstrap.cc:492] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a: Bootstrap starting.
I20260618 23:20:05.139802 11981 raft_consensus.cc:374] T e35b2734915447fc8a9238debf65409b P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:05.139824 11981 raft_consensus.cc:729] T e35b2734915447fc8a9238debf65409b P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f2d5a64f1c441deb9b1187016982214, State: Initialized, Role: FOLLOWER
I20260618 23:20:05.139866 11981 consensus_queue.cc:260] T e35b2734915447fc8a9238debf65409b P 4f2d5a64f1c441deb9b1187016982214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:05.139946 11981 ts_tablet_manager.cc:1428] T e35b2734915447fc8a9238debf65409b P 4f2d5a64f1c441deb9b1187016982214: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:05.140090 11980 tablet_bootstrap.cc:654] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:05.140393 11982 tablet_bootstrap.cc:492] T e35b2734915447fc8a9238debf65409b P 9be62c22063c452e9a6690890e66a8c1: Bootstrap starting.
I20260618 23:20:05.140769 11982 tablet_bootstrap.cc:654] T e35b2734915447fc8a9238debf65409b P 9be62c22063c452e9a6690890e66a8c1: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:05.141404 11982 tablet_bootstrap.cc:492] T e35b2734915447fc8a9238debf65409b P 9be62c22063c452e9a6690890e66a8c1: No bootstrap required, opened a new log
I20260618 23:20:05.141451 11982 ts_tablet_manager.cc:1397] T e35b2734915447fc8a9238debf65409b P 9be62c22063c452e9a6690890e66a8c1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:05.141608 11982 raft_consensus.cc:348] T e35b2734915447fc8a9238debf65409b P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:05.141674 11982 raft_consensus.cc:374] T e35b2734915447fc8a9238debf65409b P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:05.141695 11982 raft_consensus.cc:729] T e35b2734915447fc8a9238debf65409b P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9be62c22063c452e9a6690890e66a8c1, State: Initialized, Role: FOLLOWER
I20260618 23:20:05.141736 11982 consensus_queue.cc:260] T e35b2734915447fc8a9238debf65409b P 9be62c22063c452e9a6690890e66a8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:05.141824 11982 ts_tablet_manager.cc:1428] T e35b2734915447fc8a9238debf65409b P 9be62c22063c452e9a6690890e66a8c1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:05.142006 11980 tablet_bootstrap.cc:492] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a: No bootstrap required, opened a new log
I20260618 23:20:05.142155 11980 ts_tablet_manager.cc:1397] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260618 23:20:05.142354 11980 raft_consensus.cc:348] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:05.142668 11980 raft_consensus.cc:374] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:05.142774 11980 raft_consensus.cc:729] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0e911c72bde4b599396f0d97a6baf9a, State: Initialized, Role: FOLLOWER
I20260618 23:20:05.142824 11980 consensus_queue.cc:260] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:05.142930 11980 ts_tablet_manager.cc:1428] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:05.194509 12000 raft_consensus.cc:482] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:20:05.194620 12000 raft_consensus.cc:504] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:05.194787 12000 leader_election.cc:288] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f2d5a64f1c441deb9b1187016982214 (127.3.217.129:43563), 9be62c22063c452e9a6690890e66a8c1 (127.3.217.131:37945)
I20260618 23:20:05.195170 11626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e35b2734915447fc8a9238debf65409b" candidate_uuid: "d0e911c72bde4b599396f0d97a6baf9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f2d5a64f1c441deb9b1187016982214" is_pre_election: true
I20260618 23:20:05.195261 11626 raft_consensus.cc:2454] T e35b2734915447fc8a9238debf65409b P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0e911c72bde4b599396f0d97a6baf9a in term 0.
I20260618 23:20:05.195467 11697 leader_election.cc:302] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f2d5a64f1c441deb9b1187016982214, d0e911c72bde4b599396f0d97a6baf9a; no voters:
I20260618 23:20:05.195377 11906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e35b2734915447fc8a9238debf65409b" candidate_uuid: "d0e911c72bde4b599396f0d97a6baf9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9be62c22063c452e9a6690890e66a8c1" is_pre_election: true
I20260618 23:20:05.195547 12000 raft_consensus.cc:2781] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:20:05.195575 12000 raft_consensus.cc:482] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:20:05.195597 12000 raft_consensus.cc:3037] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:05.195698 11906 raft_consensus.cc:2454] T e35b2734915447fc8a9238debf65409b P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0e911c72bde4b599396f0d97a6baf9a in term 0.
I20260618 23:20:05.196518 12000 raft_consensus.cc:504] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:05.196666 12000 leader_election.cc:288] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a [CANDIDATE]: Term 1 election: Requested vote from peers 4f2d5a64f1c441deb9b1187016982214 (127.3.217.129:43563), 9be62c22063c452e9a6690890e66a8c1 (127.3.217.131:37945)
I20260618 23:20:05.196822 11626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e35b2734915447fc8a9238debf65409b" candidate_uuid: "d0e911c72bde4b599396f0d97a6baf9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f2d5a64f1c441deb9b1187016982214"
I20260618 23:20:05.196879 11626 raft_consensus.cc:3037] T e35b2734915447fc8a9238debf65409b P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:05.196887 11906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e35b2734915447fc8a9238debf65409b" candidate_uuid: "d0e911c72bde4b599396f0d97a6baf9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9be62c22063c452e9a6690890e66a8c1"
I20260618 23:20:05.196996 11906 raft_consensus.cc:3037] T e35b2734915447fc8a9238debf65409b P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:05.197675 11626 raft_consensus.cc:2454] T e35b2734915447fc8a9238debf65409b P 4f2d5a64f1c441deb9b1187016982214 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0e911c72bde4b599396f0d97a6baf9a in term 1.
I20260618 23:20:05.197810 11906 raft_consensus.cc:2454] T e35b2734915447fc8a9238debf65409b P 9be62c22063c452e9a6690890e66a8c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0e911c72bde4b599396f0d97a6baf9a in term 1.
I20260618 23:20:05.197827 11697 leader_election.cc:302] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f2d5a64f1c441deb9b1187016982214, d0e911c72bde4b599396f0d97a6baf9a; no voters:
I20260618 23:20:05.197896 12000 raft_consensus.cc:2781] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:20:05.197924 12000 raft_consensus.cc:686] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a [term 1 LEADER]: Becoming Leader. State: Replica: d0e911c72bde4b599396f0d97a6baf9a, State: Running, Role: LEADER
I20260618 23:20:05.197960 12000 consensus_queue.cc:237] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:05.198503 11469 catalog_manager.cc:5495] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a reported cstate change: term changed from 0 to 1, leader changed from <none> to d0e911c72bde4b599396f0d97a6baf9a (127.3.217.130). New cstate: current_term: 1 leader_uuid: "d0e911c72bde4b599396f0d97a6baf9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } health_report { overall_health: UNKNOWN } } }
I20260618 23:20:05.206629 11978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:05.203490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33082 (local address 127.3.217.130:36367)
0618 23:20:05.203548 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:05.203550 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:05.203568 (+ 18us) server_negotiation.cc:407] Connection header received
0618 23:20:05.203618 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:05.203619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:05.203628 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:05.203680 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:20:05.203932 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:05.204406 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:05.205534 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:05.205905 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:05.206074 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:05.206378 (+ 304us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:20:05.206408 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:20:05.206474 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:05.206560 (+ 86us) server_negotiation.cc:299] Negotiation successful
0618 23:20:05.206578 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260618 23:20:05.207392 11906 raft_consensus.cc:1261] T e35b2734915447fc8a9238debf65409b P 9be62c22063c452e9a6690890e66a8c1 [term 1 FOLLOWER]: Refusing update from remote peer d0e911c72bde4b599396f0d97a6baf9a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:20:05.207477 11626 raft_consensus.cc:1261] T e35b2734915447fc8a9238debf65409b P 4f2d5a64f1c441deb9b1187016982214 [term 1 FOLLOWER]: Refusing update from remote peer d0e911c72bde4b599396f0d97a6baf9a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:20:05.207615 11986 consensus_queue.cc:1035] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:20:05.207710 12000 consensus_queue.cc:1035] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:20:05.209980 11469 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:20:05.210076 11469 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:20:05.210796 11469 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c: Sending DeleteTablet for 3 replicas of tablet e35b2734915447fc8a9238debf65409b
I20260618 23:20:05.211026 11746 tablet_service.cc:1514] Processing DeleteTablet for tablet e35b2734915447fc8a9238debf65409b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:20:05 UTC) from {username='oryx', principal='oryx/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:33048
I20260618 23:20:05.211030 11745 tablet_service.cc:1514] Processing DeleteTablet for tablet e35b2734915447fc8a9238debf65409b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:20:05 UTC) from {username='oryx', principal='oryx/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:33048
I20260618 23:20:05.211140 11886 tablet_service.cc:1514] Processing DeleteTablet for tablet e35b2734915447fc8a9238debf65409b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:20:05 UTC) from {username='oryx', principal='oryx/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:39114
I20260618 23:20:05.211222 12005 tablet_replica.cc:330] T e35b2734915447fc8a9238debf65409b P 9be62c22063c452e9a6690890e66a8c1: stopping tablet replica
I20260618 23:20:05.211222 11606 tablet_service.cc:1514] Processing DeleteTablet for tablet e35b2734915447fc8a9238debf65409b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:20:05 UTC) from {username='oryx', principal='oryx/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:43710
I20260618 23:20:05.211304 12005 raft_consensus.cc:2229] T e35b2734915447fc8a9238debf65409b P 9be62c22063c452e9a6690890e66a8c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:20:05.211304 12004 tablet_replica.cc:330] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a: stopping tablet replica
I20260618 23:20:05.211318 12003 tablet_replica.cc:330] T e35b2734915447fc8a9238debf65409b P 4f2d5a64f1c441deb9b1187016982214: stopping tablet replica
I20260618 23:20:05.211345 12005 raft_consensus.cc:2258] T e35b2734915447fc8a9238debf65409b P 9be62c22063c452e9a6690890e66a8c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:20:05.211381 12004 raft_consensus.cc:2229] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:20:05.211387 12003 raft_consensus.cc:2229] T e35b2734915447fc8a9238debf65409b P 4f2d5a64f1c441deb9b1187016982214 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:20:05.211440 12003 raft_consensus.cc:2258] T e35b2734915447fc8a9238debf65409b P 4f2d5a64f1c441deb9b1187016982214 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:20:05.211436 12004 raft_consensus.cc:2258] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:20:05.211788 12003 ts_tablet_manager.cc:1905] T e35b2734915447fc8a9238debf65409b P 4f2d5a64f1c441deb9b1187016982214: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:20:05.211835 12005 ts_tablet_manager.cc:1905] T e35b2734915447fc8a9238debf65409b P 9be62c22063c452e9a6690890e66a8c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:20:05.212179 11469 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39108:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:20:05.212306 11469 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:20:05.213581 11606 tablet_service.cc:1467] Processing CreateTablet for tablet 821b21864a824f509c451baca0e6a53e (DEFAULT_TABLE table=test-table [id=d778febdc6f0460fbba2ddca1e118014]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:20:05.213590 12003 ts_tablet_manager.cc:1918] T e35b2734915447fc8a9238debf65409b P 4f2d5a64f1c441deb9b1187016982214: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:20:05.213619 11745 tablet_service.cc:1467] Processing CreateTablet for tablet 821b21864a824f509c451baca0e6a53e (DEFAULT_TABLE table=test-table [id=d778febdc6f0460fbba2ddca1e118014]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:20:05.213675 12003 log.cc:1196] T e35b2734915447fc8a9238debf65409b P 4f2d5a64f1c441deb9b1187016982214: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-0/wal/wals/e35b2734915447fc8a9238debf65409b
I20260618 23:20:05.213701 11606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 821b21864a824f509c451baca0e6a53e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:05.213721 11745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 821b21864a824f509c451baca0e6a53e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:05.213914 12003 ts_tablet_manager.cc:1939] T e35b2734915447fc8a9238debf65409b P 4f2d5a64f1c441deb9b1187016982214: Deleting consensus metadata
I20260618 23:20:05.214192 11453 catalog_manager.cc:4841] TS 4f2d5a64f1c441deb9b1187016982214 (127.3.217.129:43563): tablet e35b2734915447fc8a9238debf65409b (table test-table [id=fd5ef4db03e840e2a904b7d364fb5cb8]) successfully deleted
I20260618 23:20:05.214843 11886 tablet_service.cc:1467] Processing CreateTablet for tablet 821b21864a824f509c451baca0e6a53e (DEFAULT_TABLE table=test-table [id=d778febdc6f0460fbba2ddca1e118014]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:20:05.215190 11980 tablet_bootstrap.cc:492] T 821b21864a824f509c451baca0e6a53e P d0e911c72bde4b599396f0d97a6baf9a: Bootstrap starting.
I20260618 23:20:05.215217 11981 tablet_bootstrap.cc:492] T 821b21864a824f509c451baca0e6a53e P 4f2d5a64f1c441deb9b1187016982214: Bootstrap starting.
I20260618 23:20:05.215214 12004 ts_tablet_manager.cc:1905] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:20:05.215569 11980 tablet_bootstrap.cc:654] T 821b21864a824f509c451baca0e6a53e P d0e911c72bde4b599396f0d97a6baf9a: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:05.215791 11981 tablet_bootstrap.cc:654] T 821b21864a824f509c451baca0e6a53e P 4f2d5a64f1c441deb9b1187016982214: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:05.216216 11886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 821b21864a824f509c451baca0e6a53e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:05.216500 11981 tablet_bootstrap.cc:492] T 821b21864a824f509c451baca0e6a53e P 4f2d5a64f1c441deb9b1187016982214: No bootstrap required, opened a new log
I20260618 23:20:05.216535 11981 ts_tablet_manager.cc:1397] T 821b21864a824f509c451baca0e6a53e P 4f2d5a64f1c441deb9b1187016982214: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260618 23:20:05.216589 12004 ts_tablet_manager.cc:1918] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:20:05.216639 12004 log.cc:1196] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/e35b2734915447fc8a9238debf65409b
I20260618 23:20:05.216686 11981 raft_consensus.cc:348] T 821b21864a824f509c451baca0e6a53e P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:05.216742 11981 raft_consensus.cc:374] T 821b21864a824f509c451baca0e6a53e P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:05.216766 11981 raft_consensus.cc:729] T 821b21864a824f509c451baca0e6a53e P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f2d5a64f1c441deb9b1187016982214, State: Initialized, Role: FOLLOWER
I20260618 23:20:05.216806 11981 consensus_queue.cc:260] T 821b21864a824f509c451baca0e6a53e P 4f2d5a64f1c441deb9b1187016982214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:05.216848 12004 ts_tablet_manager.cc:1939] T e35b2734915447fc8a9238debf65409b P d0e911c72bde4b599396f0d97a6baf9a: Deleting consensus metadata
I20260618 23:20:05.216893 11981 ts_tablet_manager.cc:1428] T 821b21864a824f509c451baca0e6a53e P 4f2d5a64f1c441deb9b1187016982214: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:05.216213 12005 ts_tablet_manager.cc:1918] T e35b2734915447fc8a9238debf65409b P 9be62c22063c452e9a6690890e66a8c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:20:05.217581 12005 log.cc:1196] T e35b2734915447fc8a9238debf65409b P 9be62c22063c452e9a6690890e66a8c1: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/e35b2734915447fc8a9238debf65409b
I20260618 23:20:05.217528 11982 tablet_bootstrap.cc:492] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1: Bootstrap starting.
I20260618 23:20:05.217800 12005 ts_tablet_manager.cc:1939] T e35b2734915447fc8a9238debf65409b P 9be62c22063c452e9a6690890e66a8c1: Deleting consensus metadata
I20260618 23:20:05.218030 11982 tablet_bootstrap.cc:654] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:05.218452 11980 tablet_bootstrap.cc:492] T 821b21864a824f509c451baca0e6a53e P d0e911c72bde4b599396f0d97a6baf9a: No bootstrap required, opened a new log
I20260618 23:20:05.218441 11456 catalog_manager.cc:4841] TS 9be62c22063c452e9a6690890e66a8c1 (127.3.217.131:37945): tablet e35b2734915447fc8a9238debf65409b (table test-table [id=fd5ef4db03e840e2a904b7d364fb5cb8]) successfully deleted
I20260618 23:20:05.218506 11980 ts_tablet_manager.cc:1397] T 821b21864a824f509c451baca0e6a53e P d0e911c72bde4b599396f0d97a6baf9a: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260618 23:20:05.218540 11455 catalog_manager.cc:4841] TS d0e911c72bde4b599396f0d97a6baf9a (127.3.217.130:36367): tablet e35b2734915447fc8a9238debf65409b (table test-table [id=fd5ef4db03e840e2a904b7d364fb5cb8]) successfully deleted
I20260618 23:20:05.218614 11980 raft_consensus.cc:348] T 821b21864a824f509c451baca0e6a53e P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
W20260618 23:20:05.218648 11455 catalog_manager.cc:4808] TS d0e911c72bde4b599396f0d97a6baf9a (127.3.217.130:36367): delete failed for tablet e35b2734915447fc8a9238debf65409b because the tablet was not found. No further retry: Not found: Tablet not found: e35b2734915447fc8a9238debf65409b
I20260618 23:20:05.218675 11980 raft_consensus.cc:374] T 821b21864a824f509c451baca0e6a53e P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:05.218695 11980 raft_consensus.cc:729] T 821b21864a824f509c451baca0e6a53e P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0e911c72bde4b599396f0d97a6baf9a, State: Initialized, Role: FOLLOWER
I20260618 23:20:05.218767 11980 consensus_queue.cc:260] T 821b21864a824f509c451baca0e6a53e P d0e911c72bde4b599396f0d97a6baf9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:05.218868 11980 ts_tablet_manager.cc:1428] T 821b21864a824f509c451baca0e6a53e P d0e911c72bde4b599396f0d97a6baf9a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:05.223162 11982 tablet_bootstrap.cc:492] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1: No bootstrap required, opened a new log
I20260618 23:20:05.223233 11982 ts_tablet_manager.cc:1397] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260618 23:20:05.223376 11982 raft_consensus.cc:348] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:05.223451 11982 raft_consensus.cc:374] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:05.223475 11982 raft_consensus.cc:729] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9be62c22063c452e9a6690890e66a8c1, State: Initialized, Role: FOLLOWER
I20260618 23:20:05.223522 11982 consensus_queue.cc:260] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:05.223615 11982 ts_tablet_manager.cc:1428] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:05.452507 12033 raft_consensus.cc:482] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:20:05.452677 12033 raft_consensus.cc:504] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:05.452879 12033 leader_election.cc:288] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f2d5a64f1c441deb9b1187016982214 (127.3.217.129:43563), d0e911c72bde4b599396f0d97a6baf9a (127.3.217.130:36367)
I20260618 23:20:05.453127 11626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "821b21864a824f509c451baca0e6a53e" candidate_uuid: "9be62c22063c452e9a6690890e66a8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f2d5a64f1c441deb9b1187016982214" is_pre_election: true
I20260618 23:20:05.453233 11626 raft_consensus.cc:2454] T 821b21864a824f509c451baca0e6a53e P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9be62c22063c452e9a6690890e66a8c1 in term 0.
I20260618 23:20:05.453200 11766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "821b21864a824f509c451baca0e6a53e" candidate_uuid: "9be62c22063c452e9a6690890e66a8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0e911c72bde4b599396f0d97a6baf9a" is_pre_election: true
I20260618 23:20:05.453279 11766 raft_consensus.cc:2454] T 821b21864a824f509c451baca0e6a53e P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9be62c22063c452e9a6690890e66a8c1 in term 0.
I20260618 23:20:05.453437 11837 leader_election.cc:302] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f2d5a64f1c441deb9b1187016982214, 9be62c22063c452e9a6690890e66a8c1; no voters:
I20260618 23:20:05.453552 12033 raft_consensus.cc:2781] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:20:05.453600 12033 raft_consensus.cc:482] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:20:05.453630 12033 raft_consensus.cc:3037] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:05.454397 12033 raft_consensus.cc:504] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:05.454541 12033 leader_election.cc:288] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1 [CANDIDATE]: Term 1 election: Requested vote from peers 4f2d5a64f1c441deb9b1187016982214 (127.3.217.129:43563), d0e911c72bde4b599396f0d97a6baf9a (127.3.217.130:36367)
I20260618 23:20:05.454748 11626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "821b21864a824f509c451baca0e6a53e" candidate_uuid: "9be62c22063c452e9a6690890e66a8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f2d5a64f1c441deb9b1187016982214"
I20260618 23:20:05.454855 11626 raft_consensus.cc:3037] T 821b21864a824f509c451baca0e6a53e P 4f2d5a64f1c441deb9b1187016982214 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:05.454846 11766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "821b21864a824f509c451baca0e6a53e" candidate_uuid: "9be62c22063c452e9a6690890e66a8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0e911c72bde4b599396f0d97a6baf9a"
I20260618 23:20:05.454903 11766 raft_consensus.cc:3037] T 821b21864a824f509c451baca0e6a53e P d0e911c72bde4b599396f0d97a6baf9a [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:05.455605 11626 raft_consensus.cc:2454] T 821b21864a824f509c451baca0e6a53e P 4f2d5a64f1c441deb9b1187016982214 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9be62c22063c452e9a6690890e66a8c1 in term 1.
I20260618 23:20:05.455655 11766 raft_consensus.cc:2454] T 821b21864a824f509c451baca0e6a53e P d0e911c72bde4b599396f0d97a6baf9a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9be62c22063c452e9a6690890e66a8c1 in term 1.
I20260618 23:20:05.455796 11839 leader_election.cc:302] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9be62c22063c452e9a6690890e66a8c1, d0e911c72bde4b599396f0d97a6baf9a; no voters:
I20260618 23:20:05.455894 12033 raft_consensus.cc:2781] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:20:05.455945 12033 raft_consensus.cc:686] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9be62c22063c452e9a6690890e66a8c1, State: Running, Role: LEADER
I20260618 23:20:05.455994 12033 consensus_queue.cc:237] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } }
I20260618 23:20:05.456614 11469 catalog_manager.cc:5495] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9be62c22063c452e9a6690890e66a8c1 (127.3.217.131). New cstate: current_term: 1 leader_uuid: "9be62c22063c452e9a6690890e66a8c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9be62c22063c452e9a6690890e66a8c1" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37945 } health_report { overall_health: HEALTHY } } }
I20260618 23:20:05.509330 11979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:05.507117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39122 (local address 127.3.217.131:37945)
0618 23:20:05.507157 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:05.507160 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:05.507191 (+ 31us) server_negotiation.cc:407] Connection header received
0618 23:20:05.507212 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:05.507213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:05.507225 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:05.507266 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:20:05.507457 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:05.507953 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:05.508674 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:05.508879 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:05.508963 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:05.509101 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:20:05.509132 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:20:05.509180 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:05.509230 (+ 50us) server_negotiation.cc:299] Negotiation successful
0618 23:20:05.509248 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260618 23:20:05.511531 11766 raft_consensus.cc:1261] T 821b21864a824f509c451baca0e6a53e P d0e911c72bde4b599396f0d97a6baf9a [term 1 FOLLOWER]: Refusing update from remote peer 9be62c22063c452e9a6690890e66a8c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:20:05.511565 11626 raft_consensus.cc:1261] T 821b21864a824f509c451baca0e6a53e P 4f2d5a64f1c441deb9b1187016982214 [term 1 FOLLOWER]: Refusing update from remote peer 9be62c22063c452e9a6690890e66a8c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:20:05.511750 11987 consensus_queue.cc:1035] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0e911c72bde4b599396f0d97a6baf9a" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:20:05.511837 12033 consensus_queue.cc:1035] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f2d5a64f1c441deb9b1187016982214" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:20:05.523033 11469 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:20:05.523151 11469 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:20:05.523833 11469 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 473f3a016c7348e6bc30c31c3a22e97c: Sending DeleteTablet for 3 replicas of tablet 821b21864a824f509c451baca0e6a53e
I20260618 23:20:05.524103 11745 tablet_service.cc:1514] Processing DeleteTablet for tablet 821b21864a824f509c451baca0e6a53e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:20:05 UTC) from {username='oryx', principal='oryx/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:33048
I20260618 23:20:05.524125 11886 tablet_service.cc:1514] Processing DeleteTablet for tablet 821b21864a824f509c451baca0e6a53e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:20:05 UTC) from {username='oryx', principal='oryx/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:39114
I20260618 23:20:05.524210 12004 tablet_replica.cc:330] T 821b21864a824f509c451baca0e6a53e P d0e911c72bde4b599396f0d97a6baf9a: stopping tablet replica
I20260618 23:20:05.524230 11606 tablet_service.cc:1514] Processing DeleteTablet for tablet 821b21864a824f509c451baca0e6a53e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:20:05 UTC) from {username='oryx', principal='oryx/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:43710
I20260618 23:20:05.524258 12004 raft_consensus.cc:2229] T 821b21864a824f509c451baca0e6a53e P d0e911c72bde4b599396f0d97a6baf9a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:20:05.524299 12004 raft_consensus.cc:2258] T 821b21864a824f509c451baca0e6a53e P d0e911c72bde4b599396f0d97a6baf9a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:20:05.524317 12005 tablet_replica.cc:330] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1: stopping tablet replica
I20260618 23:20:05.524362 12005 raft_consensus.cc:2229] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1 [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:20:05.524462 12005 raft_consensus.cc:2258] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:20:05.524534 12003 tablet_replica.cc:330] T 821b21864a824f509c451baca0e6a53e P 4f2d5a64f1c441deb9b1187016982214: stopping tablet replica
I20260618 23:20:05.524590 12003 raft_consensus.cc:2229] T 821b21864a824f509c451baca0e6a53e P 4f2d5a64f1c441deb9b1187016982214 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:20:05.524633 12003 raft_consensus.cc:2258] T 821b21864a824f509c451baca0e6a53e P 4f2d5a64f1c441deb9b1187016982214 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:20:05.524688 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 11541
I20260618 23:20:05.526497 12004 ts_tablet_manager.cc:1905] T 821b21864a824f509c451baca0e6a53e P d0e911c72bde4b599396f0d97a6baf9a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:20:05.528046 12005 ts_tablet_manager.cc:1905] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:20:05.528254 12004 ts_tablet_manager.cc:1918] T 821b21864a824f509c451baca0e6a53e P d0e911c72bde4b599396f0d97a6baf9a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260618 23:20:05.528329 12004 log.cc:1196] T 821b21864a824f509c451baca0e6a53e P d0e911c72bde4b599396f0d97a6baf9a: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/821b21864a824f509c451baca0e6a53e
I20260618 23:20:05.528565 12004 ts_tablet_manager.cc:1939] T 821b21864a824f509c451baca0e6a53e P d0e911c72bde4b599396f0d97a6baf9a: Deleting consensus metadata
I20260618 23:20:05.528890 11455 catalog_manager.cc:4841] TS d0e911c72bde4b599396f0d97a6baf9a (127.3.217.130:36367): tablet 821b21864a824f509c451baca0e6a53e (table test-table [id=d778febdc6f0460fbba2ddca1e118014]) successfully deleted
I20260618 23:20:05.529321 12005 ts_tablet_manager.cc:1918] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260618 23:20:05.529404 12005 log.cc:1196] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/821b21864a824f509c451baca0e6a53e
I20260618 23:20:05.529644 12005 ts_tablet_manager.cc:1939] T 821b21864a824f509c451baca0e6a53e P 9be62c22063c452e9a6690890e66a8c1: Deleting consensus metadata
I20260618 23:20:05.530156 11456 catalog_manager.cc:4841] TS 9be62c22063c452e9a6690890e66a8c1 (127.3.217.131:37945): tablet 821b21864a824f509c451baca0e6a53e (table test-table [id=d778febdc6f0460fbba2ddca1e118014]) successfully deleted
W20260618 23:20:05.530802 11453 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.217.129:43563 (error 108)
I20260618 23:20:05.531322 12063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:05.531190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:43563 (local address 127.0.0.1:43712)
0618 23:20:05.531257 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:05.531290 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.129:43563: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53,"thread_start_us":41,"threads_started":1}
W20260618 23:20:05.531436 11453 catalog_manager.cc:4584] TS 4f2d5a64f1c441deb9b1187016982214 (127.3.217.129:43563): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 821b21864a824f509c451baca0e6a53e: Network error: Client connection negotiation failed: client connection to 127.3.217.129:43563: connect: Connection refused (error 111)
I20260618 23:20:05.531466 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 11681
I20260618 23:20:05.537731 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 11821
I20260618 23:20:05.543251 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 11437
2026-06-18T23:20:05Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2869 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:20:05 dist-test-slave-r9ct krb5kdc[12066](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:20:05 dist-test-slave-r9ct krb5kdc[12066](info): set up 2 sockets
Jun 18 23:20:05 dist-test-slave-r9ct krb5kdc[12066](info): commencing operation
krb5kdc: starting...
W20260618 23:20:06.627686 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:20:06 dist-test-slave-r9ct krb5kdc[12066](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824806, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:20:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:20:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:20:06.758236 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:42121
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:35871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:42121
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:20:06.839253 12079 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:06.839455 12079 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:06.839478 12079 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:06.840555 12079 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:20:06.840593 12079 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:06.840607 12079 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:06.840620 12079 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:20:06.840632 12079 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:20:06.842041 12079 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:35871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:42121
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:42121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12079
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:06.842283 12079 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:06.842463 12079 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:06.847962 12087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:06.848129 12084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:06.848608 12085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:06.848531 12079 server_base.cc:1034] running on GCE node
I20260618 23:20:06.848868 12079 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:06.849226 12079 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:06.850680 12079 hybrid_clock.cc:648] HybridClock initialized: now 1781824806850516 us; error 99 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-06-18T23:20:06Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1312 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:20:06 dist-test-slave-r9ct krb5kdc[12092](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:20:06 dist-test-slave-r9ct krb5kdc[12092](info): set up 2 sockets
Jun 18 23:20:06 dist-test-slave-r9ct krb5kdc[12092](info): commencing operation
krb5kdc: starting...
W20260618 23:20:07.940040 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:20:08 dist-test-slave-r9ct krb5kdc[12092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:20:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:20:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:20:08.075955 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:37217
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:37217
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:20:08.170634 12105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:08.170967 12105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:08.170994 12105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:08.172165 12105 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:20:08.172207 12105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:08.172222 12105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:08.172235 12105 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:20:08.172247 12105 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:20:08.174157 12105 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:37217
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:37217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12105
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:08.174592 12105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:08.174901 12105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:08.180075 12110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:08.180192 12111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:08.180192 12113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:08.180610 12105 server_base.cc:1034] running on GCE node
I20260618 23:20:08.180841 12105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:08.181151 12105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:08.182366 12105 hybrid_clock.cc:648] HybridClock initialized: now 1781824808182342 us; error 40 us; skew 500 ppm
Jun 18 23:20:08 dist-test-slave-r9ct krb5kdc[12092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824808, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:20:08.190582 12105 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:20:08.191148 12105 webserver.cc:460] Webserver started at http://127.3.217.190:44435/ using document root <none> and password file <none>
I20260618 23:20:08.191356 12105 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:08.191397 12105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:08.191486 12105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:20:08.193039 12105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "c2cc5f0207364b8cb042426c24ef9bf1"
format_stamp: "Formatted at 2026-06-18 23:20:08 on dist-test-slave-r9ct"
server_key: "68d36fb5613ae4a042f4405d6fb7cc2a"
server_key_iv: "d2694974ec4eccb762d006123dc557d5"
server_key_version: "encryptionkey@0"
I20260618 23:20:08.193567 12105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "c2cc5f0207364b8cb042426c24ef9bf1"
format_stamp: "Formatted at 2026-06-18 23:20:08 on dist-test-slave-r9ct"
server_key: "68d36fb5613ae4a042f4405d6fb7cc2a"
server_key_iv: "d2694974ec4eccb762d006123dc557d5"
server_key_version: "encryptionkey@0"
I20260618 23:20:08.195605 12105 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260618 23:20:08.196621 12120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:08.196964 12105 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:08.197062 12105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "c2cc5f0207364b8cb042426c24ef9bf1"
format_stamp: "Formatted at 2026-06-18 23:20:08 on dist-test-slave-r9ct"
server_key: "68d36fb5613ae4a042f4405d6fb7cc2a"
server_key_iv: "d2694974ec4eccb762d006123dc557d5"
server_key_version: "encryptionkey@0"
I20260618 23:20:08.197199 12105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:08.222576 12105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:08.225222 12105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:08.225365 12105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:08.230257 12105 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:37217
I20260618 23:20:08.230285 12172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:37217 every 8 connection(s)
I20260618 23:20:08.230674 12105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:20:08.231568 12173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:08.231889 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 12105
I20260618 23:20:08.232059 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:20:08.232275 3942 external_mini_cluster.cc:1428] Setting key 42f9459f4b10ce8a68de6a77459de600
I20260618 23:20:08.234694 12173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1: Bootstrap starting.
I20260618 23:20:08.235327 12173 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:08.235611 12173 log.cc:824] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1: Log is configured to *not* fsync() on all Append() calls
I20260618 23:20:08.236496 12173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1: No bootstrap required, opened a new log
I20260618 23:20:08.238971 12173 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2cc5f0207364b8cb042426c24ef9bf1" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37217 } }
I20260618 23:20:08.239164 12173 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:08.239203 12173 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2cc5f0207364b8cb042426c24ef9bf1, State: Initialized, Role: FOLLOWER
I20260618 23:20:08.239372 12173 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2cc5f0207364b8cb042426c24ef9bf1" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37217 } }
I20260618 23:20:08.239465 12173 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:20:08.239501 12173 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:20:08.239563 12173 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [term 0 FOLLOWER]: Advancing to term 1
Jun 18 23:20:08 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:20:08.240286 12173 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2cc5f0207364b8cb042426c24ef9bf1" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37217 } }
I20260618 23:20:08.240388 12173 leader_election.cc:302] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2cc5f0207364b8cb042426c24ef9bf1; no voters:
I20260618 23:20:08.240574 12173 leader_election.cc:288] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:20:08.240653 12178 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:20:08.240839 12173 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:20:08.240844 12178 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [term 1 LEADER]: Becoming Leader. State: Replica: c2cc5f0207364b8cb042426c24ef9bf1, State: Running, Role: LEADER
I20260618 23:20:08.240994 12178 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2cc5f0207364b8cb042426c24ef9bf1" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37217 } }
I20260618 23:20:08.241354 12180 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2cc5f0207364b8cb042426c24ef9bf1. Latest consensus state: current_term: 1 leader_uuid: "c2cc5f0207364b8cb042426c24ef9bf1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2cc5f0207364b8cb042426c24ef9bf1" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37217 } } }
I20260618 23:20:08.241448 12180 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [sys.catalog]: This master's current role is: LEADER
I20260618 23:20:08.242151 12179 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2cc5f0207364b8cb042426c24ef9bf1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2cc5f0207364b8cb042426c24ef9bf1" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37217 } } }
I20260618 23:20:08.242436 12179 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [sys.catalog]: This master's current role is: LEADER
W20260618 23:20:08.243338 12194 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260618 23:20:08.243440 12194 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260618 23:20:08.243539 12187 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:20:08.243726 12187 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:20:08.245011 12176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:08.232841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59406 (local address 127.3.217.190:37217)
0618 23:20:08.233056 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:08.233064 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:08.233090 (+ 26us) server_negotiation.cc:407] Connection header received
0618 23:20:08.233542 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:08.233549 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:08.233595 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:08.233721 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:08.234491 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:08.236046 (+ 1555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:08.237269 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:08.237739 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:08.237838 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:08.240848 (+ 3010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:08.240852 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:08.240853 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:08.240864 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:08.243108 (+ 2244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:08.243481 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:08.243484 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:08.243484 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:08.243593 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:08.243809 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:08.243810 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:08.243811 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:08.244104 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:08.244244 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:08.244640 (+ 396us) server_negotiation.cc:299] Negotiation successful
0618 23:20:08.244789 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":118,"threads_started":1}
I20260618 23:20:08.245728 12187 catalog_manager.cc:1347] Generated new cluster ID: c6cc769dd26247cdbb16efc6fb238c0c
I20260618 23:20:08.245795 12187 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:20:08.257591 12187 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:20:08.258165 12187 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:20:08.267262 12187 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1: Generated new TSK 0
I20260618 23:20:08.267445 12187 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.217.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
I20260618 23:20:08.307446 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:37217
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:20:08.393428 12199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:08.393661 12199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:08.393692 12199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:08.395968 12199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:08.396031 12199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:08.396060 12199 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:20:08.397519 12199 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:37217
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:08.397696 12199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:08.397867 12199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:08.403090 12207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:08.403105 12204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:08.403097 12205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:08.403400 12199 server_base.cc:1034] running on GCE node
I20260618 23:20:08.403596 12199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:08.403820 12199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:08.405071 12199 hybrid_clock.cc:648] HybridClock initialized: now 1781824808405055 us; error 44 us; skew 500 ppm
Jun 18 23:20:08 dist-test-slave-r9ct krb5kdc[12092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824808, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:20:08.408103 12199 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:20:08.408645 12199 webserver.cc:460] Webserver started at http://127.3.217.129:34509/ using document root <none> and password file <none>
I20260618 23:20:08.408991 12199 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:08.409058 12199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:08.409198 12199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:20:08.410312 12199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "7474ae32c7e74e7aafe4e484e9bf0e39"
format_stamp: "Formatted at 2026-06-18 23:20:08 on dist-test-slave-r9ct"
server_key: "b876eca71d5680367187d29620dcfd6f"
server_key_iv: "585a1352ff3e5d725f2b2a46937b87f7"
server_key_version: "encryptionkey@0"
I20260618 23:20:08.410662 12199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "7474ae32c7e74e7aafe4e484e9bf0e39"
format_stamp: "Formatted at 2026-06-18 23:20:08 on dist-test-slave-r9ct"
server_key: "b876eca71d5680367187d29620dcfd6f"
server_key_iv: "585a1352ff3e5d725f2b2a46937b87f7"
server_key_version: "encryptionkey@0"
I20260618 23:20:08.412113 12199 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:08.412961 12214 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:08.413177 12199 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:08.413260 12199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "7474ae32c7e74e7aafe4e484e9bf0e39"
format_stamp: "Formatted at 2026-06-18 23:20:08 on dist-test-slave-r9ct"
server_key: "b876eca71d5680367187d29620dcfd6f"
server_key_iv: "585a1352ff3e5d725f2b2a46937b87f7"
server_key_version: "encryptionkey@0"
I20260618 23:20:08.413308 12199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:08.422206 12199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:08.424480 12199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:08.424597 12199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:08.424785 12199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:20:08.425115 12199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:20:08.425151 12199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:08.425174 12199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:20:08.425186 12199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:08.432024 12199 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:36491
I20260618 23:20:08.432111 12327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:36491 every 8 connection(s)
I20260618 23:20:08.432425 12199 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
Jun 18 23:20:08 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824808, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:20:08.442657 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 12199
I20260618 23:20:08.442807 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:20:08.443137 3942 external_mini_cluster.cc:1428] Setting key 925cc68d377caa1c5badf8bc0af6d745
I20260618 23:20:08.444537 12330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:08.433689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.129:60279)
0618 23:20:08.433929 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:08.433977 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:08.434570 (+ 593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:08.434993 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:08.434996 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:08.435557 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:08.435748 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:08.435752 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:08.436469 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:08.436470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:08.437328 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:08.437330 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:08.437820 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:08.437821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:08.437965 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:08.438545 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:08.438554 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:08.440469 (+ 1915us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:08.442899 (+ 2430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:08.442906 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:08.442909 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:08.443173 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:08.443407 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:08.443408 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:08.443409 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:08.443586 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:08.444003 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:08.444010 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:08.444149 (+ 139us) client_negotiation.cc:769] Sending connection context
0618 23:20:08.444239 (+ 90us) client_negotiation.cc:240] Negotiation successful
0618 23:20:08.444367 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":117,"threads_started":1}
I20260618 23:20:08.444550 12176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:08.433755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:60279 (local address 127.3.217.190:37217)
0618 23:20:08.433849 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:08.433852 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:08.434192 (+ 340us) server_negotiation.cc:407] Connection header received
0618 23:20:08.434782 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:08.434783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:08.434798 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:08.434886 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:08.435862 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:08.436353 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:08.437467 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:08.437722 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:08.437794 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:08.440610 (+ 2816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:08.440612 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:08.440612 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:08.440619 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:08.442801 (+ 2182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:08.443272 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:08.443273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:08.443274 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:08.443336 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:08.443688 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:08.443689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:08.443689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:08.443879 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:08.443955 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:08.444298 (+ 343us) server_negotiation.cc:299] Negotiation successful
0618 23:20:08.444392 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260618 23:20:08.445061 12328 heartbeater.cc:347] Connected to a master server at 127.3.217.190:37217
I20260618 23:20:08.445168 12328 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:08.445367 12328 heartbeater.cc:511] Master 127.3.217.190:37217 requested a full tablet report, sending...
I20260618 23:20:08.445971 12137 ts_manager.cc:194] Registered new tserver with Master: 7474ae32c7e74e7aafe4e484e9bf0e39 (127.3.217.129:36491)
I20260618 23:20:08.446877 12137 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:60279
WARNING: no policy specified for kudu/127.3.217.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
I20260618 23:20:08.475066 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:37217
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:20:08.559386 12333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:08.559600 12333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:08.559624 12333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:08.560958 12333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:08.561035 12333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:08.561064 12333 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:20:08.562507 12333 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:37217
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:08.562754 12333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:08.563079 12333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:08.568904 12339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:08.568961 12338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:08.569146 12341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:08.568996 12333 server_base.cc:1034] running on GCE node
I20260618 23:20:08.569485 12333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:08.570245 12333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:08.571457 12333 hybrid_clock.cc:648] HybridClock initialized: now 1781824808571436 us; error 33 us; skew 500 ppm
Jun 18 23:20:08 dist-test-slave-r9ct krb5kdc[12092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824808, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:20:08.574790 12333 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:20:08.575330 12333 webserver.cc:460] Webserver started at http://127.3.217.130:41483/ using document root <none> and password file <none>
I20260618 23:20:08.575568 12333 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:08.575636 12333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:08.575778 12333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:20:08.576828 12333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "efa4213c88504a679e71239171c323af"
format_stamp: "Formatted at 2026-06-18 23:20:08 on dist-test-slave-r9ct"
server_key: "5d04145bf761a0b37f5681933c704bf4"
server_key_iv: "fdd7ebede350c76e0df8f94bee5a3c3b"
server_key_version: "encryptionkey@0"
I20260618 23:20:08.577194 12333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "efa4213c88504a679e71239171c323af"
format_stamp: "Formatted at 2026-06-18 23:20:08 on dist-test-slave-r9ct"
server_key: "5d04145bf761a0b37f5681933c704bf4"
server_key_iv: "fdd7ebede350c76e0df8f94bee5a3c3b"
server_key_version: "encryptionkey@0"
I20260618 23:20:08.578661 12333 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:20:08.579547 12348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:08.579852 12333 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:20:08.579963 12333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "efa4213c88504a679e71239171c323af"
format_stamp: "Formatted at 2026-06-18 23:20:08 on dist-test-slave-r9ct"
server_key: "5d04145bf761a0b37f5681933c704bf4"
server_key_iv: "fdd7ebede350c76e0df8f94bee5a3c3b"
server_key_version: "encryptionkey@0"
I20260618 23:20:08.580060 12333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:08.604130 12333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:08.606416 12333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:08.606598 12333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:08.606860 12333 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:20:08.607172 12333 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:20:08.607226 12333 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:08.607265 12333 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:20:08.607296 12333 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:08.614156 12333 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:35785
I20260618 23:20:08.614190 12461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:35785 every 8 connection(s)
I20260618 23:20:08.614521 12333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:20:08.621233 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 12333
I20260618 23:20:08.621342 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:20:08.621594 3942 external_mini_cluster.cc:1428] Setting key 772e3e71dd4b8a99557cabb9165a61de
Jun 18 23:20:08 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824808, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:20:08.627195 12176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:08.615296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:40835 (local address 127.3.217.190:37217)
0618 23:20:08.615361 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:08.615363 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:08.615750 (+ 387us) server_negotiation.cc:407] Connection header received
0618 23:20:08.616722 (+ 972us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:08.616724 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:08.616739 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:08.616812 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:08.618259 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:08.618902 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:08.620080 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:08.620262 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:08.620333 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:08.623920 (+ 3587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:08.623922 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:08.623922 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:08.623930 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:08.625521 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:08.626009 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:08.626011 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:08.626011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:08.626073 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:08.626364 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:08.626365 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:08.626365 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:08.626528 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:08.626606 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:08.626978 (+ 372us) server_negotiation.cc:299] Negotiation successful
0618 23:20:08.627064 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260618 23:20:08.627250 12464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:08.615276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.130:40835)
0618 23:20:08.615430 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:08.615466 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:08.616448 (+ 982us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:08.616967 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:08.616972 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:08.617842 (+ 870us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:08.618114 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:08.618121 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:08.619078 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:08.619080 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:08.619886 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:08.619889 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:08.620391 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:08.620392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:08.620502 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:08.621603 (+ 1101us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:08.621615 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:08.623723 (+ 2108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:08.625630 (+ 1907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:08.625636 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:08.625638 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:08.625927 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:08.626173 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:08.626174 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:08.626175 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:08.626285 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:08.626605 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:08.626610 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:08.626796 (+ 186us) client_negotiation.cc:769] Sending connection context
0618 23:20:08.626950 (+ 154us) client_negotiation.cc:240] Negotiation successful
0618 23:20:08.627087 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":87,"threads_started":1}
I20260618 23:20:08.627838 12462 heartbeater.cc:347] Connected to a master server at 127.3.217.190:37217
I20260618 23:20:08.627948 12462 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:08.628123 12462 heartbeater.cc:511] Master 127.3.217.190:37217 requested a full tablet report, sending...
I20260618 23:20:08.628508 12137 ts_manager.cc:194] Registered new tserver with Master: efa4213c88504a679e71239171c323af (127.3.217.130:35785)
I20260618 23:20:08.629043 12137 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:40835
WARNING: no policy specified for kudu/127.3.217.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
I20260618 23:20:08.652053 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:37217
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:20:08.737309 12467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:08.737520 12467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:08.737545 12467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:08.738698 12467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:08.738759 12467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:08.738786 12467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:20:08.740449 12467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:37217
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:08.740706 12467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:08.740929 12467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:08.747684 12472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:08.747706 12467 server_base.cc:1034] running on GCE node
W20260618 23:20:08.747843 12475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:08.747706 12473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:08.748220 12467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:08.748802 12467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:08.750008 12467 hybrid_clock.cc:648] HybridClock initialized: now 1781824808749972 us; error 69 us; skew 500 ppm
Jun 18 23:20:08 dist-test-slave-r9ct krb5kdc[12092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824808, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:20:08.753434 12467 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:20:08.753895 12467 webserver.cc:460] Webserver started at http://127.3.217.131:39393/ using document root <none> and password file <none>
I20260618 23:20:08.754172 12467 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:08.754258 12467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:08.754393 12467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:20:08.755599 12467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "364d18bd684543259537b2b7ee0debe2"
format_stamp: "Formatted at 2026-06-18 23:20:08 on dist-test-slave-r9ct"
server_key: "07fb0f6ddf2d29270d605a96a6291649"
server_key_iv: "ad43069947a1325c04e7db66b6397019"
server_key_version: "encryptionkey@0"
I20260618 23:20:08.756038 12467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "364d18bd684543259537b2b7ee0debe2"
format_stamp: "Formatted at 2026-06-18 23:20:08 on dist-test-slave-r9ct"
server_key: "07fb0f6ddf2d29270d605a96a6291649"
server_key_iv: "ad43069947a1325c04e7db66b6397019"
server_key_version: "encryptionkey@0"
I20260618 23:20:08.757477 12467 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260618 23:20:08.758795 12482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:08.759038 12467 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260618 23:20:08.759135 12467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "364d18bd684543259537b2b7ee0debe2"
format_stamp: "Formatted at 2026-06-18 23:20:08 on dist-test-slave-r9ct"
server_key: "07fb0f6ddf2d29270d605a96a6291649"
server_key_iv: "ad43069947a1325c04e7db66b6397019"
server_key_version: "encryptionkey@0"
I20260618 23:20:08.759217 12467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:08.773196 12467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:08.775873 12467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:08.776031 12467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:08.776552 12467 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:20:08.776943 12467 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:20:08.777002 12467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:08.777046 12467 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:20:08.777074 12467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:08.784014 12467 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:32859
I20260618 23:20:08.784072 12595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:32859 every 8 connection(s)
I20260618 23:20:08.784444 12467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:20:08.788336 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 12467
I20260618 23:20:08.788431 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:20:08.788740 3942 external_mini_cluster.cc:1428] Setting key 2dd12547f507030d274a70bc8c033c63
Jun 18 23:20:08 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824808, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:20:08.797612 12176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:08.785289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:35153 (local address 127.3.217.190:37217)
0618 23:20:08.785365 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:08.785367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:08.785827 (+ 460us) server_negotiation.cc:407] Connection header received
0618 23:20:08.786154 (+ 327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:08.786155 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:08.786165 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:08.786234 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:08.787270 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:08.787796 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:08.789472 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:08.789687 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:08.789764 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:08.793163 (+ 3399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:08.793165 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:08.793165 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:08.793173 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:08.795797 (+ 2624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:08.796584 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:08.796585 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:08.796586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:08.796659 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:08.796925 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:08.796926 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:08.796926 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:08.797059 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:08.797134 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:08.797420 (+ 286us) server_negotiation.cc:299] Negotiation successful
0618 23:20:08.797514 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260618 23:20:08.797812 12598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:08.785276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.131:35153)
0618 23:20:08.785466 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:08.785507 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:08.786000 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:08.786286 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:08.786289 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:08.786958 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:08.787171 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:08.787176 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:08.787987 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:08.787988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:08.789363 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:08.789365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:08.789769 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:08.789770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:08.789904 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:08.790557 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:08.790565 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:08.793011 (+ 2446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:08.796201 (+ 3190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:08.796209 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:08.796211 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:08.796469 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:08.796731 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:08.796732 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:08.796732 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:08.796845 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:08.797135 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:08.797143 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:08.797282 (+ 139us) client_negotiation.cc:769] Sending connection context
0618 23:20:08.797398 (+ 116us) client_negotiation.cc:240] Negotiation successful
0618 23:20:08.797579 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":105,"threads_started":1}
I20260618 23:20:08.798398 12596 heartbeater.cc:347] Connected to a master server at 127.3.217.190:37217
I20260618 23:20:08.798803 12596 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:08.799098 12596 heartbeater.cc:511] Master 127.3.217.190:37217 requested a full tablet report, sending...
I20260618 23:20:08.799919 12137 ts_manager.cc:194] Registered new tserver with Master: 364d18bd684543259537b2b7ee0debe2 (127.3.217.131:32859)
I20260618 23:20:08.800576 12137 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:35153
I20260618 23:20:08.802294 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.3.217.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.217.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.217.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.129.keytab.
Entry for principal oryx/127.3.217.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.129.keytab.
WARNING: no policy specified for oryx/127.3.217.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.217.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.217.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.130.keytab.
Entry for principal oryx/127.3.217.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.130.keytab.
WARNING: no policy specified for oryx/127.3.217.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.217.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.217.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.131.keytab.
Entry for principal oryx/127.3.217.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.131.keytab.
I20260618 23:20:08.904311 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 12199
I20260618 23:20:08.908854 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 12333
I20260618 23:20:08.913125 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 12467
I20260618 23:20:08.917657 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 12105
I20260618 23:20:08.923609 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:37217
--webserver_interface=127.3.217.190
--webserver_port=44435
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:37217
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:20:09.012601 12605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:09.012810 12605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:09.012838 12605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:09.013964 12605 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:20:09.014008 12605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:09.014022 12605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:09.014035 12605 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:20:09.014047 12605 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:20:09.015551 12605 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:37217
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:37217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=44435
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12605
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:09.015775 12605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:09.016036 12605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:09.021140 12613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:09.021162 12611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:09.021171 12610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:09.021337 12605 server_base.cc:1034] running on GCE node
I20260618 23:20:09.021685 12605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:09.022050 12605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:09.023214 12605 hybrid_clock.cc:648] HybridClock initialized: now 1781824809023203 us; error 29 us; skew 500 ppm
Jun 18 23:20:09 dist-test-slave-r9ct krb5kdc[12092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824809, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:20:09.025908 12605 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:20:09.026317 12605 webserver.cc:460] Webserver started at http://127.3.217.190:44435/ using document root <none> and password file <none>
I20260618 23:20:09.026561 12605 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:09.026643 12605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:09.027982 12605 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:09.028731 12620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:09.029181 12605 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:09.029284 12605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "c2cc5f0207364b8cb042426c24ef9bf1"
format_stamp: "Formatted at 2026-06-18 23:20:08 on dist-test-slave-r9ct"
server_key: "68d36fb5613ae4a042f4405d6fb7cc2a"
server_key_iv: "d2694974ec4eccb762d006123dc557d5"
server_key_version: "encryptionkey@0"
I20260618 23:20:09.029611 12605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:09.057484 12605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:09.059530 12605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:09.059648 12605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:09.063426 12605 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:37217
I20260618 23:20:09.063486 12672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:37217 every 8 connection(s)
I20260618 23:20:09.063864 12605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:20:09.065480 12673 sys_catalog.cc:263] Verifying existing consensus state
I20260618 23:20:09.066183 12673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1: Bootstrap starting.
I20260618 23:20:09.068846 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 12605
I20260618 23:20:09.069247 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:36491
--local_ip_for_outbound_sockets=127.3.217.129
--tserver_master_addrs=127.3.217.190:37217
--webserver_port=34509
--webserver_interface=127.3.217.129
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.3.217.129
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260618 23:20:09.074550 12673 log.cc:824] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1: Log is configured to *not* fsync() on all Append() calls
I20260618 23:20:09.076264 12673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260618 23:20:09.076556 12673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1: Bootstrap complete.
I20260618 23:20:09.079330 12673 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2cc5f0207364b8cb042426c24ef9bf1" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37217 } }
I20260618 23:20:09.079566 12673 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2cc5f0207364b8cb042426c24ef9bf1, State: Initialized, Role: FOLLOWER
I20260618 23:20:09.079759 12673 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2cc5f0207364b8cb042426c24ef9bf1" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37217 } }
I20260618 23:20:09.079854 12673 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:20:09.079905 12673 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:20:09.079952 12673 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [term 1 FOLLOWER]: Advancing to term 2
I20260618 23:20:09.080874 12673 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2cc5f0207364b8cb042426c24ef9bf1" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37217 } }
I20260618 23:20:09.080986 12673 leader_election.cc:302] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2cc5f0207364b8cb042426c24ef9bf1; no voters:
I20260618 23:20:09.081177 12673 leader_election.cc:288] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260618 23:20:09.081211 12677 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [term 2 FOLLOWER]: Leader election won for term 2
I20260618 23:20:09.081326 12677 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [term 2 LEADER]: Becoming Leader. State: Replica: c2cc5f0207364b8cb042426c24ef9bf1, State: Running, Role: LEADER
I20260618 23:20:09.081430 12673 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:20:09.081416 12677 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2cc5f0207364b8cb042426c24ef9bf1" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37217 } }
I20260618 23:20:09.081674 12678 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c2cc5f0207364b8cb042426c24ef9bf1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2cc5f0207364b8cb042426c24ef9bf1" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37217 } } }
I20260618 23:20:09.081754 12678 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [sys.catalog]: This master's current role is: LEADER
I20260618 23:20:09.081993 12679 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2cc5f0207364b8cb042426c24ef9bf1. Latest consensus state: current_term: 2 leader_uuid: "c2cc5f0207364b8cb042426c24ef9bf1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2cc5f0207364b8cb042426c24ef9bf1" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37217 } } }
I20260618 23:20:09.082091 12679 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1 [sys.catalog]: This master's current role is: LEADER
I20260618 23:20:09.082268 12682 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:20:09.082702 12682 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:20:09.083712 12682 catalog_manager.cc:1259] Loaded cluster ID: c6cc769dd26247cdbb16efc6fb238c0c
I20260618 23:20:09.083758 12682 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:20:09.084926 12682 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:20:09.085088 12682 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c2cc5f0207364b8cb042426c24ef9bf1: Loaded TSK: 0
I20260618 23:20:09.085281 12682 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260618 23:20:09.156759 12675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:09.156963 12675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:09.156987 12675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:09.158154 12675 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:09.158195 12675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:09.158222 12675 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:20:09.160343 12675 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.129.keytab
--principal=oryx/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:36491
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=34509
--tserver_master_addrs=127.3.217.190:37217
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12675
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:09.160630 12675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:09.160883 12675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:09.166527 12702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:09.166512 12699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:09.166867 12700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:09.166863 12675 server_base.cc:1034] running on GCE node
I20260618 23:20:09.167155 12675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:09.167397 12675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:09.168619 12675 hybrid_clock.cc:648] HybridClock initialized: now 1781824809168595 us; error 41 us; skew 500 ppm
Jun 18 23:20:09 dist-test-slave-r9ct krb5kdc[12092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824809, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:20:09.176409 12675 init.cc:377] Logged in from keytab as oryx/127.3.217.129@KRBTEST.COM (short username oryx)
I20260618 23:20:09.177039 12675 webserver.cc:460] Webserver started at http://127.3.217.129:34509/ using document root <none> and password file <none>
I20260618 23:20:09.177377 12675 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:09.177510 12675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:09.179049 12675 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260618 23:20:09.179766 12709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:09.180066 12675 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:20:09.180184 12675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "7474ae32c7e74e7aafe4e484e9bf0e39"
format_stamp: "Formatted at 2026-06-18 23:20:08 on dist-test-slave-r9ct"
server_key: "b876eca71d5680367187d29620dcfd6f"
server_key_iv: "585a1352ff3e5d725f2b2a46937b87f7"
server_key_version: "encryptionkey@0"
I20260618 23:20:09.180624 12675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:09.206663 12675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:09.209028 12675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:09.209192 12675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:09.209455 12675 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:20:09.209806 12675 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:20:09.209860 12675 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:09.209900 12675 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:20:09.209935 12675 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:09.217476 12675 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:36491
I20260618 23:20:09.217514 12822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:36491 every 8 connection(s)
I20260618 23:20:09.217909 12675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
Jun 18 23:20:09 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:09 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:09.225997 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 12675
I20260618 23:20:09.226286 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:35785
--local_ip_for_outbound_sockets=127.3.217.130
--tserver_master_addrs=127.3.217.190:37217
--webserver_port=41483
--webserver_interface=127.3.217.130
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.3.217.130
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260618 23:20:09.227288 12825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:09.218775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.129:51027)
0618 23:20:09.218967 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:09.219048 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:09.219497 (+ 449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:09.220162 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:09.220165 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:09.220741 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:09.220917 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:09.220922 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.222038 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.222039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:09.222833 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:09.222835 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.223413 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.223414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:09.223542 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:09.224185 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:09.224197 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:09.227099 (+ 2902us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":119,"threads_started":1}
W20260618 23:20:09.227490 12826 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:09.219306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:51027 (local address 127.3.217.190:37217)
0618 23:20:09.219594 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:09.219605 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:09.219654 (+ 49us) server_negotiation.cc:407] Connection header received
0618 23:20:09.219899 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:09.219905 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:09.219958 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:09.220082 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:09.221068 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.221950 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.222928 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.223325 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.223412 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:09.227262 (+ 3850us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.129:51027: BlockingRecv error: recv got EOF from 127.3.217.129:51027 (error 108)
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":168,"threads_started":1}
W20260618 23:20:09.227689 12823 heartbeater.cc:644] Failed to heartbeat to 127.3.217.190:37217 (0 consecutive failures): Not authorized: Failed to ping master at 127.3.217.190:37217: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Jun 18 23:20:09 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:09 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:09.233446 12828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:09.228141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.129:49411)
0618 23:20:09.228292 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:09.228303 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:09.228359 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:09.228564 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:09.228565 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:09.228705 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:09.228756 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:09.228757 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.229719 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.229720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:09.230284 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:09.230285 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.230729 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.230730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:09.230800 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:09.231275 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:09.231285 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:09.233325 (+ 2040us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":99,"threads_started":1}
W20260618 23:20:09.233464 12826 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:09.228202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:49411 (local address 127.3.217.190:37217)
0618 23:20:09.228433 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:09.228436 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:09.228446 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:20:09.228470 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:09.228471 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:09.228484 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:09.228555 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:09.228834 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.229632 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.230391 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.230615 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.230694 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:09.233418 (+ 2724us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.129:49411: BlockingRecv error: recv got EOF from 127.3.217.129:49411 (error 108)
Metrics: {"server-negotiator.queue_time_us":208}
Jun 18 23:20:09 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:09 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:09.239779 12828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:09.233870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.129:40523)
0618 23:20:09.234096 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:09.234115 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:09.234238 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:09.234664 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:09.234666 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:09.234854 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:09.234897 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:09.234899 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.235823 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.235824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:09.236740 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:09.236743 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.237140 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.237142 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:09.237215 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:09.237712 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:09.237718 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:09.239704 (+ 1986us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173}
W20260618 23:20:09.240042 12823 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260618 23:20:09.240193 12826 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:09.233980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:40523 (local address 127.3.217.190:37217)
0618 23:20:09.234054 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:09.234056 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:09.234269 (+ 213us) server_negotiation.cc:407] Connection header received
0618 23:20:09.234409 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:09.234410 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:09.234510 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:09.234583 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:09.235088 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.235725 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.236840 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.237059 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.237116 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:09.239816 (+ 2700us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.129:40523: BlockingRecv error: recv got EOF from 127.3.217.129:40523 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260618 23:20:09.330216 12827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:09.330541 12827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:09.330586 12827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:09.332836 12827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:09.332901 12827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:09.332952 12827 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:20:09.335994 12827 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.130.keytab
--principal=oryx/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:35785
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=41483
--tserver_master_addrs=127.3.217.190:37217
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12827
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:09.336377 12827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:09.336724 12827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:09.343864 12833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:09.343820 12834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:09.344020 12836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:09.346494 12827 server_base.cc:1034] running on GCE node
I20260618 23:20:09.346680 12827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:09.347029 12827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:09.348228 12827 hybrid_clock.cc:648] HybridClock initialized: now 1781824809348207 us; error 32 us; skew 500 ppm
Jun 18 23:20:09 dist-test-slave-r9ct krb5kdc[12092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824809, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:20:09.351632 12827 init.cc:377] Logged in from keytab as oryx/127.3.217.130@KRBTEST.COM (short username oryx)
I20260618 23:20:09.352396 12827 webserver.cc:460] Webserver started at http://127.3.217.130:41483/ using document root <none> and password file <none>
I20260618 23:20:09.352685 12827 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:09.352778 12827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:09.354375 12827 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260618 23:20:09.355293 12843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:09.355706 12827 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260618 23:20:09.355836 12827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "efa4213c88504a679e71239171c323af"
format_stamp: "Formatted at 2026-06-18 23:20:08 on dist-test-slave-r9ct"
server_key: "5d04145bf761a0b37f5681933c704bf4"
server_key_iv: "fdd7ebede350c76e0df8f94bee5a3c3b"
server_key_version: "encryptionkey@0"
I20260618 23:20:09.356271 12827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:09.366326 12827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:09.369257 12827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:09.369446 12827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:09.369701 12827 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:20:09.370222 12827 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:20:09.370294 12827 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:09.370338 12827 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:20:09.370365 12827 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:09.380090 12827 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:35785
I20260618 23:20:09.380127 12956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:35785 every 8 connection(s)
I20260618 23:20:09.380513 12827 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:20:09.383509 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 12827
I20260618 23:20:09.383801 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:32859
--local_ip_for_outbound_sockets=127.3.217.131
--tserver_master_addrs=127.3.217.190:37217
--webserver_port=39393
--webserver_interface=127.3.217.131
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.3.217.131
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 18 23:20:09 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:09 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
W20260618 23:20:09.389731 12826 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:09.381293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:57033 (local address 127.3.217.190:37217)
0618 23:20:09.381365 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:09.381367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:09.381578 (+ 211us) server_negotiation.cc:407] Connection header received
0618 23:20:09.382232 (+ 654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:09.382233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:09.382249 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:09.382315 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:09.383384 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.384290 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.385313 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.385522 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.385598 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:09.389683 (+ 4085us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.130:57033: BlockingRecv error: recv got EOF from 127.3.217.130:57033 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260618 23:20:09.389825 12959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:09.381300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.130:57033)
0618 23:20:09.381457 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:09.381491 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:09.382100 (+ 609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:09.382431 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:09.382435 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:09.383076 (+ 641us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:09.383265 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:09.383269 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.384408 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.384410 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:09.385209 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:09.385212 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.385603 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.385605 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:09.385722 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:09.386321 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:09.386336 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:09.389571 (+ 3235us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":70,"threads_started":1}
W20260618 23:20:09.390072 12957 heartbeater.cc:644] Failed to heartbeat to 127.3.217.190:37217 (0 consecutive failures): Not authorized: Failed to ping master at 127.3.217.190:37217: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Jun 18 23:20:09 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:09 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:09.395397 12959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:09.390329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.130:57093)
0618 23:20:09.390383 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:09.390441 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:09.390492 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:09.390633 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:09.390634 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:09.390833 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:09.390877 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:09.390878 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.391531 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.391533 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:09.392038 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:09.392039 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.392387 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.392388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:09.392458 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:09.393042 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:09.393050 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:09.395194 (+ 2144us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":37}
W20260618 23:20:09.395437 12826 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:09.390392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:57093 (local address 127.3.217.190:37217)
0618 23:20:09.390443 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:09.390445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:09.390476 (+ 31us) server_negotiation.cc:407] Connection header received
0618 23:20:09.390551 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:09.390552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:09.390561 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:09.390631 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:09.390954 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.391437 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.392118 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.392307 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.392378 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:09.395375 (+ 2997us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.130:57093: BlockingRecv error: recv got EOF from 127.3.217.130:57093 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Jun 18 23:20:09 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:09 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:09.400331 12959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:09.395745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.130:32907)
0618 23:20:09.395787 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:09.395798 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:09.395834 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:09.395951 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:09.395951 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:09.396092 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:09.396120 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:09.396122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.396756 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.396757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:09.397279 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:09.397281 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.397637 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.397638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:09.397690 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:09.398134 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:09.398139 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:09.400268 (+ 2129us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":28}
W20260618 23:20:09.400518 12957 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260618 23:20:09.400625 12826 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:09.395781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:32907 (local address 127.3.217.190:37217)
0618 23:20:09.395862 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:09.395864 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:09.395872 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:20:09.395892 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:09.395893 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:09.395900 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:09.395949 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:09.396206 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.396664 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.397365 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.397552 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.397637 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:09.400366 (+ 2729us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.130:32907: BlockingRecv error: recv got EOF from 127.3.217.130:32907 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260618 23:20:09.467427 12960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:09.467666 12960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:09.467707 12960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:09.468993 12960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:09.469060 12960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:09.469103 12960 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:20:09.470553 12960 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/krb5kdc/oryx_127.3.217.131.keytab
--principal=oryx/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:32859
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=39393
--tserver_master_addrs=127.3.217.190:37217
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12960
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:09.470850 12960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:09.471084 12960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:09.477831 12968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:09.477778 12966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:09.478147 12960 server_base.cc:1034] running on GCE node
W20260618 23:20:09.477774 12965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:09.478603 12960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:09.478976 12960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:09.480175 12960 hybrid_clock.cc:648] HybridClock initialized: now 1781824809480121 us; error 66 us; skew 500 ppm
Jun 18 23:20:09 dist-test-slave-r9ct krb5kdc[12092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824809, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:20:09.483310 12960 init.cc:377] Logged in from keytab as oryx/127.3.217.131@KRBTEST.COM (short username oryx)
I20260618 23:20:09.483846 12960 webserver.cc:460] Webserver started at http://127.3.217.131:39393/ using document root <none> and password file <none>
I20260618 23:20:09.484103 12960 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:09.484184 12960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:09.485599 12960 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:09.486474 12975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:09.486871 12960 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:09.487025 12960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "364d18bd684543259537b2b7ee0debe2"
format_stamp: "Formatted at 2026-06-18 23:20:08 on dist-test-slave-r9ct"
server_key: "07fb0f6ddf2d29270d605a96a6291649"
server_key_iv: "ad43069947a1325c04e7db66b6397019"
server_key_version: "encryptionkey@0"
I20260618 23:20:09.487367 12960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:09.498402 12960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:09.500982 12960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:09.501165 12960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:09.501399 12960 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:20:09.501785 12960 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:20:09.501844 12960 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:09.501886 12960 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:20:09.501974 12960 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:09.508292 12960 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:32859
I20260618 23:20:09.508597 13088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:32859 every 8 connection(s)
I20260618 23:20:09.508700 12960 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:20:09.509176 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 12960
Jun 18 23:20:09 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:09 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
W20260618 23:20:09.519604 13093 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:09.510104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:41157 (local address 127.3.217.190:37217)
0618 23:20:09.510235 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:09.510237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:09.510368 (+ 131us) server_negotiation.cc:407] Connection header received
0618 23:20:09.511599 (+ 1231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:09.511600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:09.511615 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:09.511716 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:09.512999 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.513715 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.515533 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.515824 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.515917 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:09.519533 (+ 3616us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.131:41157: BlockingRecv error: recv got EOF from 127.3.217.131:41157 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":73,"threads_started":1}
I20260618 23:20:09.519621 13092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:09.509865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.131:41157)
0618 23:20:09.510110 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:09.510170 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:09.511389 (+ 1219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:09.511840 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:09.511844 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:09.512579 (+ 735us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:09.512833 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:09.512838 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.513831 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.513832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:09.515417 (+ 1585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:09.515420 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.515937 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.515938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:09.516132 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:09.516687 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:09.516696 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:09.519415 (+ 2719us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":119,"threads_started":1}
W20260618 23:20:09.519850 13089 heartbeater.cc:644] Failed to heartbeat to 127.3.217.190:37217 (0 consecutive failures): Not authorized: Failed to ping master at 127.3.217.190:37217: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
I20260618 23:20:09.520165 12826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:09.509855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59422 (local address 127.3.217.190:37217)
0618 23:20:09.509963 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:09.509966 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:09.510458 (+ 492us) server_negotiation.cc:407] Connection header received
0618 23:20:09.510577 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:09.510577 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:09.510587 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:09.510647 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:09.511616 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.512172 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.513242 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.513548 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.513633 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:09.515554 (+ 1921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:09.515558 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:09.515559 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:09.515571 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:09.518011 (+ 2440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:09.518783 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:09.518787 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:09.518787 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:09.518893 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:09.519117 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:09.519118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:09.519118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:09.519471 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:09.519625 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:09.519940 (+ 315us) server_negotiation.cc:299] Negotiation successful
0618 23:20:09.520062 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
Jun 18 23:20:09 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:09 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:09.524375 13092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:09.520064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.131:40803)
0618 23:20:09.520243 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:09.520253 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:09.520329 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:09.520485 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:09.520485 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:09.520618 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:09.520661 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:09.520662 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.521357 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.521358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:09.521858 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:09.521860 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.522212 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.522213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:09.522275 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:09.522633 (+ 358us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:09.522637 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:09.524301 (+ 1664us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165}
W20260618 23:20:09.524425 13093 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:09.520115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:40803 (local address 127.3.217.190:37217)
0618 23:20:09.520148 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:09.520150 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:09.520316 (+ 166us) server_negotiation.cc:407] Connection header received
0618 23:20:09.520386 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:09.520387 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:09.520398 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:09.520479 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:09.520740 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.521270 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.521953 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.522142 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.522215 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:09.524371 (+ 2156us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.131:40803: BlockingRecv error: recv got EOF from 127.3.217.131:40803 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
Jun 18 23:20:09 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:09 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:09.528976 13092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:09.524733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.131:33121)
0618 23:20:09.524782 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:09.524792 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:09.524854 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:09.524999 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:09.524999 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:09.525123 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:09.525145 (+ 22us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:09.525146 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.525740 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.525741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:09.526220 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:09.526221 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.526565 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.526565 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:09.526616 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:09.527015 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:09.527019 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:09.528939 (+ 1920us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260618 23:20:09.529111 13089 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260618 23:20:09.529167 13093 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:09.524794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:33121 (local address 127.3.217.190:37217)
0618 23:20:09.524848 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:09.524850 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:09.524859 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:20:09.524913 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:09.524914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:09.524924 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:09.524994 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:09.525218 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.525654 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.526296 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:09.526483 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:09.526563 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:09.529100 (+ 2537us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.131:33121: BlockingRecv error: recv got EOF from 127.3.217.131:33121 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Jun 18 23:20:10 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:10 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:10.245762 13094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:10.240435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.129:43411)
0618 23:20:10.240573 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:10.240584 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:10.240630 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:10.240780 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:10.240780 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:10.240949 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:10.240996 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:10.240998 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:10.241868 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:10.241869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:10.242389 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:10.242391 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:10.242935 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:10.242938 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:10.243015 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:10.243608 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:10.243613 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:10.245696 (+ 2083us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":77,"threads_started":1}
W20260618 23:20:10.245921 13095 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:10.240535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:43411 (local address 127.3.217.190:37217)
0618 23:20:10.240664 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:10.240666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:10.240673 (+ 7us) server_negotiation.cc:407] Connection header received
0618 23:20:10.240692 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:10.240693 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:10.240702 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:10.240765 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:10.241090 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:10.241724 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:10.242487 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:10.242694 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:10.242843 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:10.245822 (+ 2979us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.129:43411: BlockingRecv error: recv got EOF from 127.3.217.129:43411 (error 108)
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":80,"threads_started":1}
Jun 18 23:20:10 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:10 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:10.406502 13096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:10.400902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.130:56787)
0618 23:20:10.401093 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:10.401107 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:10.401207 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:10.401362 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:10.401363 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:10.401564 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:10.401610 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:10.401613 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:10.402345 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:10.402346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:10.403011 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:10.403015 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:10.403408 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:10.403409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:10.403479 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:10.404047 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:10.404053 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:10.406352 (+ 2299us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":87,"threads_started":1}
W20260618 23:20:10.406695 13095 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:10.401010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:56787 (local address 127.3.217.190:37217)
0618 23:20:10.401101 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:10.401103 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:10.401189 (+ 86us) server_negotiation.cc:407] Connection header received
0618 23:20:10.401270 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:10.401271 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:10.401285 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:10.401347 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:10.401697 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:10.402246 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:10.403121 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:10.403329 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:10.403410 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:10.406491 (+ 3081us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.130:56787: BlockingRecv error: recv got EOF from 127.3.217.130:56787 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Jun 18 23:20:10 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:10 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:10.534677 13097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:10.529530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.131:59165)
0618 23:20:10.529674 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:10.529689 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:10.529744 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:10.529985 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:10.529987 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:10.530192 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:10.530336 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:10.530339 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:10.531050 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:10.531052 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:10.531652 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:10.531654 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:10.532083 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:10.532084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:10.532130 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:10.532730 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:10.532735 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:10.534612 (+ 1877us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":95,"threads_started":1}
W20260618 23:20:10.534977 13095 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:10.529638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:59165 (local address 127.3.217.190:37217)
0618 23:20:10.529703 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:10.529705 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:10.529730 (+ 25us) server_negotiation.cc:407] Connection header received
0618 23:20:10.529785 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:10.529785 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:10.529796 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:10.529847 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:10.530449 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:10.530967 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:10.531757 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:10.531965 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:10.532031 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:10.534897 (+ 2866us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.131:59165: BlockingRecv error: recv got EOF from 127.3.217.131:59165 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Jun 18 23:20:11 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:11 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:11.251665 13098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:11.246293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.129:45583)
0618 23:20:11.246476 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:11.246489 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:11.246553 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:11.246842 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:11.246842 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:11.247002 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:11.247048 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:11.247049 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:11.248067 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:11.248068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:11.248603 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:11.248605 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:11.248972 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:11.248973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:11.249013 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:11.249448 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:11.249452 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:11.251607 (+ 2155us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":73,"threads_started":1}
W20260618 23:20:11.251982 13099 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:11.246550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:45583 (local address 127.3.217.190:37217)
0618 23:20:11.246681 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:11.246683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:11.246692 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:20:11.246744 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:11.246745 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:11.246754 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:11.246816 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:11.247209 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:11.247956 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:11.248701 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:11.248898 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:11.248962 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:11.251894 (+ 2932us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.129:45583: BlockingRecv error: recv got EOF from 127.3.217.129:45583 (error 108)
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":86,"threads_started":1}
Jun 18 23:20:11 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:11 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:11.412467 13100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:11.407154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.130:37395)
0618 23:20:11.407332 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:11.407344 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:11.407450 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:11.407624 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:11.407625 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:11.407791 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:11.407839 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:11.407841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:11.408523 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:11.408524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:11.409145 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:11.409147 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:11.409608 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:11.409609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:11.409685 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:11.410265 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:11.410270 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:11.412352 (+ 2082us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":102,"threads_started":1}
W20260618 23:20:11.412544 13099 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:11.407283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:37395 (local address 127.3.217.190:37217)
0618 23:20:11.407353 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:11.407354 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:11.407499 (+ 145us) server_negotiation.cc:407] Connection header received
0618 23:20:11.407537 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:11.407538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:11.407550 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:11.407596 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:11.407932 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:11.408440 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:11.409225 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:11.409421 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:11.409490 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:11.412471 (+ 2981us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.130:37395: BlockingRecv error: recv got EOF from 127.3.217.130:37395 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Jun 18 23:20:11 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:11 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:11.539886 13101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:11.535252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.131:33403)
0618 23:20:11.535433 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:11.535446 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:11.535512 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:11.535679 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:11.535680 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:11.535853 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:11.535897 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:11.535899 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:11.536559 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:11.536560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:11.537081 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:11.537083 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:11.537435 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:11.537436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:11.537497 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:11.537974 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:11.537979 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:11.539793 (+ 1814us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":89,"threads_started":1}
W20260618 23:20:11.539927 13099 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:11.535388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:33403 (local address 127.3.217.190:37217)
0618 23:20:11.535465 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:11.535467 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:11.535493 (+ 26us) server_negotiation.cc:407] Connection header received
0618 23:20:11.535587 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:11.535588 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:11.535600 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:11.535673 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:11.535979 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:11.536462 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:11.537166 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:11.537350 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:11.537434 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:11.539866 (+ 2432us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.131:33403: BlockingRecv error: recv got EOF from 127.3.217.131:33403 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Jun 18 23:20:12 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:12 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:12.257941 13102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:12.252502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.129:40121)
0618 23:20:12.252670 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:12.252696 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:12.252765 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:12.252987 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:12.252989 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:12.253192 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:12.253263 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:12.253265 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:12.254043 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:12.254045 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:12.254648 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:12.254650 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:12.255221 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:12.255223 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:12.255272 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:12.255773 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:12.255778 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:12.257839 (+ 2061us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":77,"threads_started":1}
W20260618 23:20:12.257980 13103 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:12.252616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:40121 (local address 127.3.217.190:37217)
0618 23:20:12.252772 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:12.252774 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:12.252785 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:20:12.252809 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:12.252809 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:12.252818 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:12.252882 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:12.253433 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:12.253927 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:12.254883 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:12.255086 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:12.255157 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:12.257912 (+ 2755us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.129:40121: BlockingRecv error: recv got EOF from 127.3.217.129:40121 (error 108)
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":69,"threads_started":1}
Jun 18 23:20:12 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:12 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:12.418560 13104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:12.413150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.130:47633)
0618 23:20:12.413311 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:12.413322 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:12.413378 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:12.413561 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:12.413562 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:12.413735 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:12.413781 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:12.413784 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:12.414453 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:12.414454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:12.415015 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:12.415017 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:12.415373 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:12.415374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:12.415422 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:12.416039 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:12.416044 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:12.418431 (+ 2387us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":98,"threads_started":1}
W20260618 23:20:12.418582 13103 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:12.413259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:47633 (local address 127.3.217.190:37217)
0618 23:20:12.413327 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:12.413329 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:12.413366 (+ 37us) server_negotiation.cc:407] Connection header received
0618 23:20:12.413437 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:12.413438 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:12.413447 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:12.413503 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:12.413861 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:12.414379 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:12.415101 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:12.415280 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:12.415341 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:12.418538 (+ 3197us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.130:47633: BlockingRecv error: recv got EOF from 127.3.217.130:47633 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Jun 18 23:20:12 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:12 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:12.545445 13105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:12.540590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.131:37733)
0618 23:20:12.540778 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:12.540791 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:12.540883 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:12.541116 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:12.541117 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:12.541291 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:12.541344 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:12.541345 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:12.542018 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:12.542019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:12.542623 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:12.542624 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:12.543025 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:12.543026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:12.543086 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:12.543570 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:12.543574 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:12.545348 (+ 1774us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":97,"threads_started":1}
W20260618 23:20:12.545493 13103 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:12.540687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:37733 (local address 127.3.217.190:37217)
0618 23:20:12.540768 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:12.540771 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:12.540863 (+ 92us) server_negotiation.cc:407] Connection header received
0618 23:20:12.541010 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:12.541011 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:12.541025 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:12.541098 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:12.541459 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:12.541938 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:12.542748 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:12.542940 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:12.543025 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:12.545430 (+ 2405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.131:37733: BlockingRecv error: recv got EOF from 127.3.217.131:37733 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Jun 18 23:20:13 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:13 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:13.269023 13106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:13.258737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.129:55213)
0618 23:20:13.258977 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:13.259175 (+ 198us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:13.259284 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:13.259450 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:13.259451 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:13.259625 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:13.259674 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:13.259676 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:13.260388 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:13.260390 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:13.260945 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:13.260947 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:13.261409 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:13.261409 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:13.261506 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:13.266582 (+ 5076us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:13.266588 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:13.268963 (+ 2375us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":158,"threads_started":1}
W20260618 23:20:13.269099 13107 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:13.258999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:55213 (local address 127.3.217.190:37217)
0618 23:20:13.259149 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:13.259151 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:13.259277 (+ 126us) server_negotiation.cc:407] Connection header received
0618 23:20:13.259332 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:13.259333 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:13.259345 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:13.259425 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:13.259745 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:13.260301 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:13.261043 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:13.261331 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:13.261409 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:13.269045 (+ 7636us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.129:55213: BlockingRecv error: recv got EOF from 127.3.217.129:55213 (error 108)
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":107,"threads_started":1}
Jun 18 23:20:13 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:13 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:13.424470 13108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:13.419394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.130:47641)
0618 23:20:13.419564 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:13.419581 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:13.419654 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:13.419826 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:13.419827 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:13.420021 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:13.420087 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:13.420089 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:13.420816 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:13.420817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:13.421363 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:13.421365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:13.421707 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:13.421708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:13.421749 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:13.422322 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:13.422327 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:13.424413 (+ 2086us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":112,"threads_started":1}
W20260618 23:20:13.424573 13107 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:13.419448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:47641 (local address 127.3.217.190:37217)
0618 23:20:13.419548 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:13.419549 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:13.419656 (+ 107us) server_negotiation.cc:407] Connection header received
0618 23:20:13.419704 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:13.419705 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:13.419716 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:13.419783 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:13.420199 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:13.420699 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:13.421455 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:13.421636 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:13.421693 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:13.424503 (+ 2810us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.130:47641: BlockingRecv error: recv got EOF from 127.3.217.130:47641 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Jun 18 23:20:13 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:13 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:13.551467 13109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:13.546136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.131:35187)
0618 23:20:13.546291 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:13.546306 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:13.546384 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:13.546762 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:13.546764 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:13.546929 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:13.546978 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:13.546980 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:13.547731 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:13.547732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:13.548269 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:13.548271 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:13.548905 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:13.548907 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:13.548958 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:13.549433 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:13.549438 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:13.551404 (+ 1966us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":102,"threads_started":1}
W20260618 23:20:13.551580 13107 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:13.546255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:35187 (local address 127.3.217.190:37217)
0618 23:20:13.546323 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:13.546325 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:13.546363 (+ 38us) server_negotiation.cc:407] Connection header received
0618 23:20:13.546573 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:13.546575 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:13.546596 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:13.546692 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:13.547132 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:13.547633 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:13.548403 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:13.548796 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:13.548873 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:13.551505 (+ 2632us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.131:35187: BlockingRecv error: recv got EOF from 127.3.217.131:35187 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Jun 18 23:20:14 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:14 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:14.274953 13110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:14.269619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.129:44341)
0618 23:20:14.269751 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:14.269762 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:14.269812 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:14.270220 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:14.270221 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:14.270375 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:14.270429 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:14.270431 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:14.271197 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:14.271198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:14.271719 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:14.271721 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:14.272174 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:14.272175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:14.272219 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:14.272832 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:14.272838 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:14.274895 (+ 2057us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":65,"threads_started":1}
W20260618 23:20:14.275113 13111 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:14.269760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:44341 (local address 127.3.217.190:37217)
0618 23:20:14.270012 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:14.270014 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:14.270028 (+ 14us) server_negotiation.cc:407] Connection header received
0618 23:20:14.270057 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:14.270058 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:14.270069 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:14.270177 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:14.270582 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:14.271115 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:14.271841 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:14.272070 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:14.272153 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:14.275016 (+ 2863us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.129:44341: BlockingRecv error: recv got EOF from 127.3.217.129:44341 (error 108)
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":170,"threads_started":1}
Jun 18 23:20:14 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:14 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:14.429975 13112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:14.425219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.130:53489)
0618 23:20:14.425508 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:14.425524 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:14.425629 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:14.425782 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:14.425783 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:14.425975 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:14.426020 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:14.426022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:14.426672 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:14.426673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:14.427244 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:14.427246 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:14.427620 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:14.427621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:14.427676 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:14.428189 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:14.428193 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:14.429880 (+ 1687us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":157,"threads_started":1}
W20260618 23:20:14.430060 13111 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:14.425459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:53489 (local address 127.3.217.190:37217)
0618 23:20:14.425549 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:14.425551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:14.425606 (+ 55us) server_negotiation.cc:407] Connection header received
0618 23:20:14.425684 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:14.425685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:14.425701 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:14.425776 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:14.426101 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:14.426590 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:14.427331 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:14.427517 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:14.427607 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:14.429957 (+ 2350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.130:53489: BlockingRecv error: recv got EOF from 127.3.217.130:53489 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Jun 18 23:20:14 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:14 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:14.557672 13113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:14.552110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.131:36457)
0618 23:20:14.552302 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:14.552314 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:14.552379 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:14.552587 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:14.552588 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:14.552746 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:14.552793 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:14.552794 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:14.553451 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:14.553452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:14.554016 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:14.554018 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:14.554424 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:14.554426 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:14.554504 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:14.555217 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:14.555222 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:14.557558 (+ 2336us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":90,"threads_started":1}
W20260618 23:20:14.557734 13111 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:14.552244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:36457 (local address 127.3.217.190:37217)
0618 23:20:14.552333 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:14.552335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:14.552362 (+ 27us) server_negotiation.cc:407] Connection header received
0618 23:20:14.552436 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:14.552437 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:14.552449 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:14.552505 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:14.552859 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:14.553364 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:14.554121 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:14.554300 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:14.554358 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:14.557663 (+ 3305us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.131:36457: BlockingRecv error: recv got EOF from 127.3.217.131:36457 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Jun 18 23:20:15 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:15 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:15.280800 13114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:15.275542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.129:54319)
0618 23:20:15.275715 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:15.275733 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:15.275792 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:15.276013 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:15.276014 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:15.276174 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:15.276221 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:15.276222 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:15.277159 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:15.277160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:15.277722 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:15.277723 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:15.278146 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:15.278147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:15.278195 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:15.278705 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:15.278740 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:15.280742 (+ 2002us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":67,"threads_started":1}
W20260618 23:20:15.281123 13115 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:15.275709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:54319 (local address 127.3.217.190:37217)
0618 23:20:15.275825 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:15.275827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:15.275836 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:20:15.275871 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:15.275871 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:15.275882 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:15.275944 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:15.276366 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:15.277049 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:15.277826 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:15.278044 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:15.278108 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:15.281051 (+ 2943us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.129:54319: BlockingRecv error: recv got EOF from 127.3.217.129:54319 (error 108)
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":67,"threads_started":1}
Jun 18 23:20:15 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:15 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:15.436729 13116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:15.430837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.130:33737)
0618 23:20:15.431124 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:15.431145 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:15.431259 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:15.431503 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:15.431504 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:15.431691 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:15.431750 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:15.431751 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:15.432742 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:15.432744 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:15.433564 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:15.433566 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:15.434075 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:15.434076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:15.434124 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:15.434726 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:15.434731 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:15.436671 (+ 1940us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":113,"threads_started":1}
W20260618 23:20:15.436971 13115 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:15.431079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:33737 (local address 127.3.217.190:37217)
0618 23:20:15.431146 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:15.431149 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:15.431329 (+ 180us) server_negotiation.cc:407] Connection header received
0618 23:20:15.431368 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:15.431368 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:15.431382 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:15.431473 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:15.431869 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:15.432612 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:15.433726 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:15.433960 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:15.434034 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:15.436784 (+ 2750us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.130:33737: BlockingRecv error: recv got EOF from 127.3.217.130:33737 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Jun 18 23:20:15 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:15 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:15.565361 13117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:15.558415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.131:33283)
0618 23:20:15.558573 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:15.558587 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:15.558701 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:15.559059 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:15.559060 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:15.559335 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:15.559394 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:15.559396 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:15.560296 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:15.560297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:15.560885 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:15.560887 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:15.561427 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:15.561428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:15.561516 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:15.562315 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:15.562319 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:15.565299 (+ 2980us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":91,"threads_started":1}
W20260618 23:20:15.565692 13115 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:15.558596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:33283 (local address 127.3.217.190:37217)
0618 23:20:15.558651 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:15.558653 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:15.558678 (+ 25us) server_negotiation.cc:407] Connection header received
0618 23:20:15.558853 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:15.558854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:15.558870 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:15.558931 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:15.559545 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:15.560193 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:15.561066 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:15.561294 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:15.561404 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:15.565627 (+ 4223us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.131:33283: BlockingRecv error: recv got EOF from 127.3.217.131:33283 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Jun 18 23:20:16 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:16 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:16.286598 13118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:16.281473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.129:55181)
0618 23:20:16.281661 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:16.281677 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:16.281779 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:16.281966 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:16.281967 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:16.282221 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:16.282299 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:16.282302 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:16.283112 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:16.283113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:16.283668 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:16.283670 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:16.284024 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:16.284025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:16.284072 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:16.284503 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:16.284508 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:16.286541 (+ 2033us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":74,"threads_started":1}
W20260618 23:20:16.286778 13119 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:16.281633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:55181 (local address 127.3.217.190:37217)
0618 23:20:16.281752 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:16.281759 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:16.281770 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:20:16.281857 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:16.281858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:16.281868 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:16.281939 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:16.282370 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:16.283000 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:16.283750 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:16.283930 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:16.283982 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:16.286657 (+ 2675us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.129:55181: BlockingRecv error: recv got EOF from 127.3.217.129:55181 (error 108)
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":66,"threads_started":1}
Jun 18 23:20:16 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:16 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:16.442790 13120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:16.437484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.130:53197)
0618 23:20:16.437716 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:16.437728 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:16.437821 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:16.438040 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:16.438041 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:16.438210 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:16.438259 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:16.438261 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:16.439111 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:16.439112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:16.439671 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:16.439673 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:16.440164 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:16.440164 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:16.440222 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:16.440850 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:16.440855 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:16.442670 (+ 1815us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":157,"threads_started":1}
W20260618 23:20:16.442855 13119 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:16.437589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:53197 (local address 127.3.217.190:37217)
0618 23:20:16.437667 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:16.437669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:16.437833 (+ 164us) server_negotiation.cc:407] Connection header received
0618 23:20:16.437866 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:16.437867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:16.437877 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:16.437953 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:16.438363 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:16.439024 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:16.439814 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:16.440060 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:16.440143 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:16.442789 (+ 2646us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.130:53197: BlockingRecv error: recv got EOF from 127.3.217.130:53197 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Jun 18 23:20:16 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:16 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:16.572201 13121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:16.566097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.131:56969)
0618 23:20:16.566238 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:16.566253 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:16.566321 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:16.566524 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:16.566524 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:16.566687 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:16.566798 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:16.566800 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:16.567787 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:16.567789 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:16.568455 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:16.568458 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:16.568898 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:16.568898 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:16.568946 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:16.569464 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:16.569471 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:16.572100 (+ 2629us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":85,"threads_started":1}
W20260618 23:20:16.572276 13119 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:16.566200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:56969 (local address 127.3.217.190:37217)
0618 23:20:16.566261 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:16.566263 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:16.566307 (+ 44us) server_negotiation.cc:407] Connection header received
0618 23:20:16.566394 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:16.566394 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:16.566416 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:16.566503 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:16.566925 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:16.567644 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:16.568611 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:16.568796 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:16.568864 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:16.572204 (+ 3340us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.131:56969: BlockingRecv error: recv got EOF from 127.3.217.131:56969 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Jun 18 23:20:17 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:17 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:17.293416 13122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:17.287171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.129:39993)
0618 23:20:17.287319 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:17.287331 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:17.287389 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:17.287701 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:17.287703 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:17.287964 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:17.288048 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:17.288051 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:17.289118 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:17.289120 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:17.289664 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:17.289666 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:17.290364 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:17.290365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:17.290449 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:17.290996 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:17.291001 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:17.293316 (+ 2315us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":102,"threads_started":1}
W20260618 23:20:17.293514 13123 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:17.287343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:39993 (local address 127.3.217.190:37217)
0618 23:20:17.287460 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:17.287462 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:17.287469 (+ 7us) server_negotiation.cc:407] Connection header received
0618 23:20:17.287517 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:17.287517 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:17.287527 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:17.287595 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:17.288251 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:17.289026 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:17.289766 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:17.290265 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:17.290359 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:17.293404 (+ 3045us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.129:39993: BlockingRecv error: recv got EOF from 127.3.217.129:39993 (error 108)
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":67,"threads_started":1}
Jun 18 23:20:17 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:17 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:17.449360 13124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:17.443304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.130:48917)
0618 23:20:17.443447 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:17.443463 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:17.443526 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:17.443734 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:17.443735 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:17.443897 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:17.443942 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:17.443944 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:17.444825 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:17.444826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:17.445372 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:17.445374 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:17.445873 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:17.445874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:17.445974 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:17.446592 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:17.446597 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:17.449264 (+ 2667us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":88,"threads_started":1}
W20260618 23:20:17.449433 13123 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:17.443405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:48917 (local address 127.3.217.190:37217)
0618 23:20:17.443476 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:17.443478 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:17.443517 (+ 39us) server_negotiation.cc:407] Connection header received
0618 23:20:17.443587 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:17.443588 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:17.443598 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:17.443668 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:17.444103 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:17.444738 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:17.445518 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:17.445703 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:17.445768 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:17.449381 (+ 3613us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.130:48917: BlockingRecv error: recv got EOF from 127.3.217.130:48917 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Jun 18 23:20:17 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:17 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:17.579293 13125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:17.572839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.131:54503)
0618 23:20:17.573079 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:17.573091 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:17.573172 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:17.573483 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:17.573485 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:17.573718 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:17.573903 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:17.573907 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:17.574995 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:17.574996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:17.575631 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:17.575633 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:17.576245 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:17.576245 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:17.576294 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:17.576918 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:17.576923 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:17.579192 (+ 2269us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":131,"threads_started":1}
W20260618 23:20:17.579368 13123 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:17.572972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:54503 (local address 127.3.217.190:37217)
0618 23:20:17.573031 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:17.573033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:17.573246 (+ 213us) server_negotiation.cc:407] Connection header received
0618 23:20:17.573285 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:17.573286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:17.573304 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:17.573365 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:17.574024 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:17.574696 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:17.575800 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:17.575969 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:17.576027 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:17.579305 (+ 3278us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.131:54503: BlockingRecv error: recv got EOF from 127.3.217.131:54503 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Jun 18 23:20:18 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:18 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:18.304947 13126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:18.294112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.129:58043)
0618 23:20:18.294269 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:18.294281 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:18.294335 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:18.294522 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:18.294523 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:18.294803 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:18.294855 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:18.294857 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:18.295606 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:18.295607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:18.296157 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:18.296158 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:18.296574 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:18.296575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:18.296639 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:18.302047 (+ 5408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:18.302055 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:18.304830 (+ 2775us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":82,"threads_started":1}
W20260618 23:20:18.305174 13127 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:18.294197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:58043 (local address 127.3.217.190:37217)
0618 23:20:18.294330 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:18.294332 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:18.294342 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:20:18.294411 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:18.294411 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:18.294425 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:18.294500 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:18.294986 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:18.295509 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:18.296243 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:18.296454 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:18.296557 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:18.305078 (+ 8521us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.129:58043: BlockingRecv error: recv got EOF from 127.3.217.129:58043 (error 108)
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":51,"threads_started":1}
Jun 18 23:20:18 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:18 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:18.455785 13128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:18.450014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.130:36083)
0618 23:20:18.450172 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:18.450187 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:18.450286 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:18.450441 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:18.450442 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:18.450648 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:18.450692 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:18.450694 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:18.451390 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:18.451391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:18.451925 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:18.451927 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:18.452633 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:18.452634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:18.452693 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:18.453213 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:18.453219 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:18.455684 (+ 2465us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":100,"threads_started":1}
W20260618 23:20:18.455835 13127 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:18.450153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:36083 (local address 127.3.217.190:37217)
0618 23:20:18.450226 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:18.450228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:18.450265 (+ 37us) server_negotiation.cc:407] Connection header received
0618 23:20:18.450366 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:18.450367 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:18.450379 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:18.450426 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:18.450806 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:18.451305 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:18.452093 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:18.452514 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:18.452631 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:18.455768 (+ 3137us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.130:36083: BlockingRecv error: recv got EOF from 127.3.217.130:36083 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Jun 18 23:20:18 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:18 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:18.585515 13129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:18.580076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.131:57511)
0618 23:20:18.580290 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:18.580301 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:18.580357 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:18.580552 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:18.580554 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:18.580733 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:18.580797 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:18.580799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:18.581646 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:18.581648 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:18.582443 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:18.582445 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:18.582968 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:18.582969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:18.583027 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:18.583521 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:18.583526 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:18.585458 (+ 1932us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":121,"threads_started":1}
W20260618 23:20:18.585702 13127 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:18.580181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:57511 (local address 127.3.217.190:37217)
0618 23:20:18.580379 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:18.580381 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:18.580396 (+ 15us) server_negotiation.cc:407] Connection header received
0618 23:20:18.580420 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:18.580421 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:18.580435 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:18.580491 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:18.580903 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:18.581521 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:18.582548 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:18.582843 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:18.582943 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:18.585641 (+ 2698us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.131:57511: BlockingRecv error: recv got EOF from 127.3.217.131:57511 (error 108)
Metrics: {"server-negotiator.queue_time_us":160}
Jun 18 23:20:19 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:19 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:19.311043 13130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:19.305668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.129:46461)
0618 23:20:19.306022 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:19.306035 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:19.306097 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:19.306248 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:19.306249 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:19.306415 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:19.306463 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:19.306465 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:19.307193 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:19.307194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:19.307731 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:19.307733 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:19.308244 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:19.308245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:19.308293 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:19.308986 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:19.308990 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:19.310984 (+ 1994us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":239,"threads_started":1}
W20260618 23:20:19.311337 13131 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:19.305962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:46461 (local address 127.3.217.190:37217)
0618 23:20:19.306091 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:19.306093 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:19.306103 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:20:19.306165 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:19.306166 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:19.306176 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:19.306229 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:19.306577 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:19.307104 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:19.307956 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:19.308141 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:19.308208 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:19.311247 (+ 3039us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.129:46461: BlockingRecv error: recv got EOF from 127.3.217.129:46461 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":75,"threads_started":1}
Jun 18 23:20:19 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:19 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:19.461781 13132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:19.456481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.130:45477)
0618 23:20:19.456667 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:19.456694 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:19.456809 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:19.457053 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:19.457054 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:19.457221 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:19.457269 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:19.457270 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:19.458064 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:19.458065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:19.458587 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:19.458589 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:19.459021 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:19.459022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:19.459083 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:19.459527 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:19.459532 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:19.461675 (+ 2143us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":86,"threads_started":1}
W20260618 23:20:19.461817 13131 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:19.456582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:45477 (local address 127.3.217.190:37217)
0618 23:20:19.456642 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:19.456644 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:19.456814 (+ 170us) server_negotiation.cc:407] Connection header received
0618 23:20:19.456884 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:19.456885 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:19.456898 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:19.456990 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:19.457391 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:19.457984 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:19.458678 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:19.458935 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:19.459020 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:19.461745 (+ 2725us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.130:45477: BlockingRecv error: recv got EOF from 127.3.217.130:45477 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Jun 18 23:20:19 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:19 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:19.590763 13133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:19.586063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.131:49497)
0618 23:20:19.586200 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:19.586215 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:19.586274 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:19.586507 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:19.586508 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:19.586677 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:19.586744 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:19.586746 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:19.587404 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:19.587406 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:19.587927 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:19.587928 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:19.588291 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:19.588292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:19.588352 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:19.588827 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:19.588831 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:19.590645 (+ 1814us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":92,"threads_started":1}
W20260618 23:20:19.590804 13131 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:19.586273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:49497 (local address 127.3.217.190:37217)
0618 23:20:19.586366 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:19.586368 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:19.586375 (+ 7us) server_negotiation.cc:407] Connection header received
0618 23:20:19.586396 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:19.586397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:19.586408 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:19.586455 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:19.586826 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:19.587322 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:19.588012 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:19.588193 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:19.588292 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:19.590740 (+ 2448us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.131:49497: BlockingRecv error: recv got EOF from 127.3.217.131:49497 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Jun 18 23:20:20 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:20 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:20.317422 13134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:20.311561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.129:47883)
0618 23:20:20.311736 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:20.311749 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:20.311801 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:20.312179 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:20.312180 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:20.312427 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:20.312491 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:20.312493 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:20.313289 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:20.313290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:20.313881 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:20.313883 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:20.314291 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:20.314293 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:20.314350 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:20.315010 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:20.315015 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:20.317352 (+ 2337us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":72,"threads_started":1}
W20260618 23:20:20.317726 13135 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:20.311751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:47883 (local address 127.3.217.190:37217)
0618 23:20:20.311958 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:20.311959 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:20.311970 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:20:20.311996 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:20.311996 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:20.312008 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:20.312162 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:20.312626 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:20.313160 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:20.313984 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:20.314188 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:20.314254 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:20.317632 (+ 3378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.129:47883: BlockingRecv error: recv got EOF from 127.3.217.129:47883 (error 108)
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":105,"threads_started":1}
Jun 18 23:20:20 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:20 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:20.467782 13136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:20.462417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.130:43449)
0618 23:20:20.462587 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:20.462598 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:20.462652 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:20.462862 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:20.462863 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:20.463040 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:20.463083 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:20.463085 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:20.463757 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:20.463758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:20.464513 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:20.464515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:20.464890 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:20.464890 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:20.464995 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:20.465594 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:20.465598 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:20.467718 (+ 2120us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":99,"threads_started":1}
W20260618 23:20:20.467967 13135 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:20.462540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:43449 (local address 127.3.217.190:37217)
0618 23:20:20.462616 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:20.462618 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:20.462640 (+ 22us) server_negotiation.cc:407] Connection header received
0618 23:20:20.462742 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:20.462742 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:20.462752 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:20.462813 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:20.463167 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:20.463665 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:20.464615 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:20.464800 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:20.464873 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:20.467878 (+ 3005us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.130:43449: BlockingRecv error: recv got EOF from 127.3.217.130:43449 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Jun 18 23:20:20 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:20 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:20.595635 13137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:20.591222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.131:56615)
0618 23:20:20.591354 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:20.591366 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:20.591426 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:20.591551 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:20.591552 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:20.591715 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:20.591761 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:20.591763 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:20.592395 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:20.592395 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:20.592923 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:20.592924 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:20.593250 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:20.593250 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:20.593286 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:20.593733 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:20.593738 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:20.595533 (+ 1795us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":79,"threads_started":1}
W20260618 23:20:20.595677 13135 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:20.591313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:56615 (local address 127.3.217.190:37217)
0618 23:20:20.591378 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:20.591380 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:20.591416 (+ 36us) server_negotiation.cc:407] Connection header received
0618 23:20:20.591466 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:20.591466 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:20.591477 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:20.591552 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:20.591822 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:20.592330 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:20.592999 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:20.593184 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:20.593240 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:20.595632 (+ 2392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.131:56615: BlockingRecv error: recv got EOF from 127.3.217.131:56615 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Jun 18 23:20:21 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:21 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:21.323170 13138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:21.317979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.129:52871)
0618 23:20:21.318157 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:21.318169 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:21.318233 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:21.318403 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:21.318404 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:21.318629 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:21.318675 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:21.318677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:21.319656 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:21.319657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:21.320186 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:21.320187 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:21.320699 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:21.320699 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:21.320741 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:21.321244 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:21.321248 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:21.323065 (+ 1817us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":97,"threads_started":1}
W20260618 23:20:21.323221 13139 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:21.318071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:52871 (local address 127.3.217.190:37217)
0618 23:20:21.318183 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:21.318185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:21.318241 (+ 56us) server_negotiation.cc:407] Connection header received
0618 23:20:21.318289 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:21.318290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:21.318299 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:21.318350 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:21.318829 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:21.319569 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:21.320336 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:21.320585 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:21.320681 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:21.323148 (+ 2467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.129:52871: BlockingRecv error: recv got EOF from 127.3.217.129:52871 (error 108)
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":53,"threads_started":1}
Jun 18 23:20:21 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:21 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:21.473601 13140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:21.468262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.130:57427)
0618 23:20:21.468433 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:21.468444 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:21.468504 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:21.468690 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:21.468691 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:21.468855 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:21.468897 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:21.468899 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:21.469561 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:21.469562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:21.470073 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:21.470074 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:21.470650 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:21.470651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:21.470750 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:21.471441 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:21.471446 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:21.473543 (+ 2097us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":88,"threads_started":1}
W20260618 23:20:21.473834 13139 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:21.468326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:57427 (local address 127.3.217.190:37217)
0618 23:20:21.468380 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:21.468382 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:21.468531 (+ 149us) server_negotiation.cc:407] Connection header received
0618 23:20:21.468561 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:21.468562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:21.468573 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:21.468635 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:21.468986 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:21.469469 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:21.470217 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:21.470487 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:21.470619 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:21.473748 (+ 3129us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.130:57427: BlockingRecv error: recv got EOF from 127.3.217.130:57427 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Jun 18 23:20:21 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:21 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:21.601534 13141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:21.596236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.131:37805)
0618 23:20:21.596378 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:21.596393 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:21.596440 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:21.596634 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:21.596635 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:21.596804 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:21.596854 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:21.596855 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:21.597785 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:21.597786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:21.598417 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:21.598419 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:21.598998 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:21.599000 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:21.599086 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:21.599654 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:21.599659 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:21.601455 (+ 1796us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":92,"threads_started":1}
W20260618 23:20:21.601645 13139 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:21.596323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:37805 (local address 127.3.217.190:37217)
0618 23:20:21.596427 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:21.596429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:21.596460 (+ 31us) server_negotiation.cc:407] Connection header received
0618 23:20:21.596540 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:21.596541 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:21.596554 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:21.596620 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:21.597032 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:21.597690 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:21.598584 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:21.598859 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:21.598940 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:21.601560 (+ 2620us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.131:37805: BlockingRecv error: recv got EOF from 127.3.217.131:37805 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Jun 18 23:20:22 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:22 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:22.329653 13142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:22.323782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.129:55873)
0618 23:20:22.324070 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:22.324082 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:22.324147 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:22.324429 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:22.324430 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:22.324697 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:22.324772 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:22.324774 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:22.325669 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:22.325670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:22.326405 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:22.326407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:22.326837 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:22.326838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:22.326909 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:22.327496 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:22.327501 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:22.329597 (+ 2096us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":157,"threads_started":1}
W20260618 23:20:22.329952 13143 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:22.323908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:55873 (local address 127.3.217.190:37217)
0618 23:20:22.324067 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:22.324069 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:22.324183 (+ 114us) server_negotiation.cc:407] Connection header received
0618 23:20:22.324218 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:22.324219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:22.324233 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:22.324302 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:22.324900 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:22.325555 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:22.326543 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:22.326767 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:22.326826 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:22.329800 (+ 2974us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.129:55873: BlockingRecv error: recv got EOF from 127.3.217.129:55873 (error 108)
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":57,"threads_started":1}
Jun 18 23:20:22 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:22 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:22.478875 13144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:22.474114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.130:59301)
0618 23:20:22.474249 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:22.474260 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:22.474306 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:22.474504 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:22.474505 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:22.474687 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:22.474758 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:22.474760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:22.475439 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:22.475440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:22.475991 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:22.475993 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:22.476396 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:22.476397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:22.476460 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:22.476960 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:22.476965 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:22.478767 (+ 1802us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":76,"threads_started":1}
W20260618 23:20:22.478912 13143 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:22.474289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:59301 (local address 127.3.217.190:37217)
0618 23:20:22.474361 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:22.474362 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:22.474371 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:20:22.474397 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:22.474397 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:22.474408 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:22.474492 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:22.474838 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:22.475349 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:22.476114 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:22.476312 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:22.476387 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:22.478841 (+ 2454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.130:59301: BlockingRecv error: recv got EOF from 127.3.217.130:59301 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Jun 18 23:20:22 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:22 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:22.607766 13145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:22.602139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.131:37107)
0618 23:20:22.602300 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:22.602311 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:22.602361 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:22.602654 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:22.602655 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:22.602861 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:22.602906 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:22.602907 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:22.603594 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:22.603595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:22.604106 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:22.604107 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:22.604463 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:22.604464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:22.604526 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:22.605038 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:22.605044 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:22.607706 (+ 2662us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":96,"threads_started":1}
W20260618 23:20:22.607896 13143 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:22.602436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:37107 (local address 127.3.217.190:37217)
0618 23:20:22.602522 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:22.602523 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:22.602530 (+ 7us) server_negotiation.cc:407] Connection header received
0618 23:20:22.602551 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:22.602551 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:22.602562 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:22.602646 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:22.602998 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:22.603498 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:22.604210 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:22.604388 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:22.604459 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:22.607807 (+ 3348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.131:37107: BlockingRecv error: recv got EOF from 127.3.217.131:37107 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Jun 18 23:20:23 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:23 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:23.342281 13146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:23.330362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.129:45113)
0618 23:20:23.330566 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:23.330579 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:23.330645 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:23.330988 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:23.330989 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:23.331167 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:23.331217 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:23.331219 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:23.332362 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:23.332363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:23.333198 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:23.333202 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:23.333891 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:23.333892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:23.333953 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:23.340345 (+ 6392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:23.340351 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:23.342221 (+ 1870us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":123,"threads_started":1}
W20260618 23:20:23.342562 13147 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:23.330589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:45113 (local address 127.3.217.190:37217)
0618 23:20:23.330772 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:23.330774 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:23.330793 (+ 19us) server_negotiation.cc:407] Connection header received
0618 23:20:23.330817 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:23.330818 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:23.330828 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:23.330918 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:23.331378 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:23.332063 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:23.333581 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:23.333785 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:23.333866 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:23.342494 (+ 8628us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.129:45113: BlockingRecv error: recv got EOF from 127.3.217.129:45113 (error 108)
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":121,"threads_started":1}
Jun 18 23:20:23 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:23 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:23.485598 13148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:23.479512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.130:41935)
0618 23:20:23.479652 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:23.479665 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:23.479731 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:23.479868 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:23.479869 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:23.480034 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:23.480079 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:23.480081 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:23.480823 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:23.480825 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:23.481664 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:23.481666 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:23.482140 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:23.482141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:23.482206 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:23.482926 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:23.482932 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:23.485505 (+ 2573us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":89,"threads_started":1}
W20260618 23:20:23.485634 13147 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:23.479619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:41935 (local address 127.3.217.190:37217)
0618 23:20:23.479689 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:23.479690 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:23.479717 (+ 27us) server_negotiation.cc:407] Connection header received
0618 23:20:23.479788 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:23.479789 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:23.479798 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:23.479854 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:23.480197 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:23.480689 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:23.481774 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:23.481961 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:23.482093 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:23.485574 (+ 3481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.130:41935: BlockingRecv error: recv got EOF from 127.3.217.130:41935 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Jun 18 23:20:23 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:23 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.131@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:23.613868 13149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:23.608441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.131:51913)
0618 23:20:23.608673 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:23.608684 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:23.608752 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:23.608892 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:23.608892 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:23.609082 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:23.609125 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:23.609126 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:23.610102 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:23.610103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:23.610654 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:23.610655 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:23.611146 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:23.611148 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:23.611209 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:23.611888 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:23.611892 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:23.613802 (+ 1910us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":121,"threads_started":1}
W20260618 23:20:23.614024 13147 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:23.608577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:51913 (local address 127.3.217.190:37217)
0618 23:20:23.608626 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:23.608628 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:23.608770 (+ 142us) server_negotiation.cc:407] Connection header received
0618 23:20:23.608796 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:23.608796 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:23.608808 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:23.608864 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:23.609291 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:23.609995 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:23.610813 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:23.611018 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:23.611083 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:23.613930 (+ 2847us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.131:51913: BlockingRecv error: recv got EOF from 127.3.217.131:51913 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Jun 18 23:20:24 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:24 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.129@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:24.348631 13150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:24.342875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.129:49457)
0618 23:20:24.343028 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:24.343044 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:24.343091 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:24.343448 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:24.343449 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:24.343613 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:24.343659 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:24.343660 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:24.344501 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:24.344502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:24.345037 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:24.345038 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:24.345605 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:24.345607 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:24.345676 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:24.346422 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:24.346427 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:24.348548 (+ 2121us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":92,"threads_started":1}
W20260618 23:20:24.348709 13151 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:24.343047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:49457 (local address 127.3.217.190:37217)
0618 23:20:24.343223 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:24.343225 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:24.343234 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:20:24.343322 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:24.343323 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:24.343340 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:24.343414 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:24.343776 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:24.344410 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:24.345138 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:24.345388 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:24.345502 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:24.348652 (+ 3150us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.129:49457: BlockingRecv error: recv got EOF from 127.3.217.129:49457 (error 108)
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":82,"threads_started":1}
Jun 18 23:20:24 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
Jun 18 23:20:24 dist-test-slave-r9ct krb5kdc[12092](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.217.130@KRBTEST.COM for oryx/127.3.217.190@KRBTEST.COM, Server not found in Kerberos database
I20260618 23:20:24.491888 13152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:24.486322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37217 (local address 127.3.217.130:52411)
0618 23:20:24.486561 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:24.486574 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:24.486645 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:24.486849 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:24.486850 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:24.487014 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:24.487086 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:24.487087 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:24.487767 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:24.487768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:24.488340 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:24.488342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:24.488758 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:24.488759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:24.488861 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:24.489540 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:24.489546 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:24.491775 (+ 2229us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.217.190:37217: Server oryx/127.3.217.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":118,"threads_started":1}
W20260618 23:20:24.491916 13151 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:24.486406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:52411 (local address 127.3.217.190:37217)
0618 23:20:24.486494 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:24.486497 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:24.486670 (+ 173us) server_negotiation.cc:407] Connection header received
0618 23:20:24.486701 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:24.486701 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:24.486763 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:24.486832 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:24.487161 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:24.487681 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:24.488425 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:24.488629 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:24.488689 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:24.491852 (+ 3163us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.217.130:52411: BlockingRecv error: recv got EOF from 127.3.217.130:52411 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260618 23:20:24.514101 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 12675
I20260618 23:20:24.519487 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 12827
I20260618 23:20:24.524214 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 12960
I20260618 23:20:24.528431 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 12605
2026-06-18T23:20:24Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17672 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-06-18T23:20:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:20:24Z Disabled control of system clock
I20260618 23:20:24.558141 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:34799
--webserver_interface=127.3.217.190
--webserver_port=0
--builtin_ntp_servers=127.3.217.148:37797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:34799
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260618 23:20:24.639168 13156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:24.639370 13156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:24.639390 13156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:24.640489 13156 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:20:24.640527 13156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:24.640540 13156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:24.640552 13156 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:20:24.640564 13156 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:20:24.641799 13156 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:37797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:34799
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:34799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13156
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:24.641975 13156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:24.642192 13156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:24.647374 13161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:24.647496 13156 server_base.cc:1034] running on GCE node
W20260618 23:20:24.647459 13164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:24.647459 13162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:24.647950 13156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:24.648247 13156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:24.649410 13156 hybrid_clock.cc:648] HybridClock initialized: now 1781824824649404 us; error 35 us; skew 500 ppm
I20260618 23:20:24.650676 13156 webserver.cc:460] Webserver started at http://127.3.217.190:45303/ using document root <none> and password file <none>
I20260618 23:20:24.650959 13156 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:24.651007 13156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:24.651095 13156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:20:24.652066 13156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "bbb1319775a84b4cb0e42e44079c2662"
format_stamp: "Formatted at 2026-06-18 23:20:24 on dist-test-slave-r9ct"
server_key: "82c5db098e97bfddd6c61bc14179f13f"
server_key_iv: "e43c63c2c08bf31e0d424f969218a959"
server_key_version: "encryptionkey@0"
I20260618 23:20:24.652366 13156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "bbb1319775a84b4cb0e42e44079c2662"
format_stamp: "Formatted at 2026-06-18 23:20:24 on dist-test-slave-r9ct"
server_key: "82c5db098e97bfddd6c61bc14179f13f"
server_key_iv: "e43c63c2c08bf31e0d424f969218a959"
server_key_version: "encryptionkey@0"
I20260618 23:20:24.653720 13156 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260618 23:20:24.654635 13170 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:24.654898 13156 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:20:24.654989 13156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "bbb1319775a84b4cb0e42e44079c2662"
format_stamp: "Formatted at 2026-06-18 23:20:24 on dist-test-slave-r9ct"
server_key: "82c5db098e97bfddd6c61bc14179f13f"
server_key_iv: "e43c63c2c08bf31e0d424f969218a959"
server_key_version: "encryptionkey@0"
I20260618 23:20:24.655047 13156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:24.671952 13156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:24.672219 13156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:24.672324 13156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:24.677057 13156 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:34799
I20260618 23:20:24.677214 13222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:34799 every 8 connection(s)
I20260618 23:20:24.677445 13156 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:20:24.678138 13223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:24.680624 13223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662: Bootstrap starting.
I20260618 23:20:24.681217 13223 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:24.681516 13223 log.cc:824] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662: Log is configured to *not* fsync() on all Append() calls
I20260618 23:20:24.682260 13223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662: No bootstrap required, opened a new log
I20260618 23:20:24.683801 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 13156
I20260618 23:20:24.683923 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:20:24.683838 13223 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbb1319775a84b4cb0e42e44079c2662" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34799 } }
I20260618 23:20:24.684082 13223 raft_consensus.cc:374] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:24.684154 13223 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbb1319775a84b4cb0e42e44079c2662, State: Initialized, Role: FOLLOWER
I20260618 23:20:24.684234 3942 external_mini_cluster.cc:1428] Setting key a8eff123a4bd95f7fcec31eb6b53db15
I20260618 23:20:24.684320 13223 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbb1319775a84b4cb0e42e44079c2662" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34799 } }
I20260618 23:20:24.684393 13223 raft_consensus.cc:388] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:20:24.684435 13223 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:20:24.684484 13223 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:24.685249 13223 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbb1319775a84b4cb0e42e44079c2662" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34799 } }
I20260618 23:20:24.685400 13223 leader_election.cc:302] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bbb1319775a84b4cb0e42e44079c2662; no voters:
I20260618 23:20:24.685588 13223 leader_election.cc:288] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:20:24.685897 13223 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:20:24.685977 13229 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:20:24.686357 13229 raft_consensus.cc:686] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662 [term 1 LEADER]: Becoming Leader. State: Replica: bbb1319775a84b4cb0e42e44079c2662, State: Running, Role: LEADER
I20260618 23:20:24.686803 13229 consensus_queue.cc:237] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbb1319775a84b4cb0e42e44079c2662" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34799 } }
I20260618 23:20:24.689786 13228 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bbb1319775a84b4cb0e42e44079c2662" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbb1319775a84b4cb0e42e44079c2662" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34799 } } }
I20260618 23:20:24.689883 13228 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662 [sys.catalog]: This master's current role is: LEADER
I20260618 23:20:24.690179 13230 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbb1319775a84b4cb0e42e44079c2662. Latest consensus state: current_term: 1 leader_uuid: "bbb1319775a84b4cb0e42e44079c2662" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbb1319775a84b4cb0e42e44079c2662" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34799 } } }
I20260618 23:20:24.690250 13230 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662 [sys.catalog]: This master's current role is: LEADER
I20260618 23:20:24.690366 13242 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:20:24.691108 13242 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:20:24.692788 13242 catalog_manager.cc:1347] Generated new cluster ID: caebb9dae2094409acd0e5965aa4ce2f
I20260618 23:20:24.692842 13242 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:20:24.696379 13227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:24.685284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60162 (local address 127.3.217.190:34799)
0618 23:20:24.685664 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:24.685676 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:24.685717 (+ 41us) server_negotiation.cc:407] Connection header received
0618 23:20:24.686002 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:24.686011 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:24.686137 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:24.686299 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:24.686632 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:24.690084 (+ 3452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:24.694192 (+ 4108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:24.694842 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:24.695366 (+ 524us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:24.695759 (+ 393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:24.695762 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:24.695763 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:20:24.695941 (+ 178us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:24.695971 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:20:24.695982 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:24.696062 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:24.696133 (+ 71us) server_negotiation.cc:299] Negotiation successful
0618 23:20:24.696211 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":131,"threads_started":1}
I20260618 23:20:24.707089 13242 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:20:24.707775 13242 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:20:24.714397 13242 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bbb1319775a84b4cb0e42e44079c2662: Generated new TSK 0
I20260618 23:20:24.714588 13242 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:20:24.724303 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34799
--builtin_ntp_servers=127.3.217.148:37797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260618 23:20:24.807380 13247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:24.807618 13247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:24.807654 13247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:24.808797 13247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:24.808867 13247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:24.808911 13247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:20:24.810266 13247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:37797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34799
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:24.810544 13247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:24.810864 13247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:24.817876 13255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:24.817870 13253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:24.817870 13252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:24.818732 13247 server_base.cc:1034] running on GCE node
I20260618 23:20:24.819006 13247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:24.819350 13247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:24.820566 13247 hybrid_clock.cc:648] HybridClock initialized: now 1781824824820536 us; error 46 us; skew 500 ppm
I20260618 23:20:24.822083 13247 webserver.cc:460] Webserver started at http://127.3.217.129:34223/ using document root <none> and password file <none>
I20260618 23:20:24.822340 13247 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:24.822412 13247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:24.822559 13247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:20:24.823706 13247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "9d07259b8bd542699dbfe3e815d2e6c1"
format_stamp: "Formatted at 2026-06-18 23:20:24 on dist-test-slave-r9ct"
server_key: "73bde68e3edfd548fc07cb0fba951e50"
server_key_iv: "f71f678ccb14ddfdd8c31c4ed670bfac"
server_key_version: "encryptionkey@0"
I20260618 23:20:24.824070 13247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "9d07259b8bd542699dbfe3e815d2e6c1"
format_stamp: "Formatted at 2026-06-18 23:20:24 on dist-test-slave-r9ct"
server_key: "73bde68e3edfd548fc07cb0fba951e50"
server_key_iv: "f71f678ccb14ddfdd8c31c4ed670bfac"
server_key_version: "encryptionkey@0"
I20260618 23:20:24.825436 13247 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260618 23:20:24.826237 13261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:24.826448 13247 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:24.826558 13247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "9d07259b8bd542699dbfe3e815d2e6c1"
format_stamp: "Formatted at 2026-06-18 23:20:24 on dist-test-slave-r9ct"
server_key: "73bde68e3edfd548fc07cb0fba951e50"
server_key_iv: "f71f678ccb14ddfdd8c31c4ed670bfac"
server_key_version: "encryptionkey@0"
I20260618 23:20:24.826639 13247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:24.848654 13247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:24.848975 13247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:24.849148 13247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:24.849378 13247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:20:24.849767 13247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:20:24.849829 13247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:24.849869 13247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:20:24.849895 13247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:24.856240 13247 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:37887
I20260618 23:20:24.856317 13374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:37887 every 8 connection(s)
I20260618 23:20:24.856664 13247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:20:24.859870 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 13247
I20260618 23:20:24.859952 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:20:24.860213 3942 external_mini_cluster.cc:1428] Setting key 5997cca414f5ff62d62de12590bf347a
I20260618 23:20:24.861195 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34799
--builtin_ntp_servers=127.3.217.148:37797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260618 23:20:24.863116 13227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:24.858018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:55457 (local address 127.3.217.190:34799)
0618 23:20:24.858087 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:24.858089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:24.858351 (+ 262us) server_negotiation.cc:407] Connection header received
0618 23:20:24.859063 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:24.859064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:24.859079 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:24.859124 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:24.859784 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:24.860509 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:24.861674 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:24.861888 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:24.861974 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:24.862832 (+ 858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:24.862833 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:24.862834 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:20:24.862839 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:24.862854 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:20:24.862858 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:24.862902 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:24.863004 (+ 102us) server_negotiation.cc:299] Negotiation successful
0618 23:20:24.863040 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260618 23:20:24.863557 13377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:24.858050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:34799 (local address 127.3.217.129:55457)
0618 23:20:24.858234 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:24.858267 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:24.858945 (+ 678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:24.859203 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:24.859206 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:24.859216 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:24.859694 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:24.859698 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:24.860621 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:24.860622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:24.861586 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:24.861589 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:24.861982 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:24.861983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:24.862116 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:24.862669 (+ 553us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:20:24.862670 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:24.862697 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:20:24.862741 (+ 44us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:24.862912 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:24.862917 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:24.862920 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:20:24.863005 (+ 85us) client_negotiation.cc:240] Negotiation successful
0618 23:20:24.863103 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":81,"threads_started":1}
I20260618 23:20:24.864082 13375 heartbeater.cc:347] Connected to a master server at 127.3.217.190:34799
I20260618 23:20:24.864174 13375 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:24.864373 13375 heartbeater.cc:511] Master 127.3.217.190:34799 requested a full tablet report, sending...
I20260618 23:20:24.864895 13187 ts_manager.cc:194] Registered new tserver with Master: 9d07259b8bd542699dbfe3e815d2e6c1 (127.3.217.129:37887)
I20260618 23:20:24.865525 13187 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.217.129:55457
W20260618 23:20:24.947407 13378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:24.947650 13378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:24.947686 13378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:24.948799 13378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:24.948864 13378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:24.948906 13378 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:20:24.950248 13378 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:37797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34799
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:24.950520 13378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:24.950862 13378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:24.956094 13386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:24.956147 13383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:24.956179 13384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:24.956489 13378 server_base.cc:1034] running on GCE node
I20260618 23:20:24.956710 13378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:24.956928 13378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:24.958142 13378 hybrid_clock.cc:648] HybridClock initialized: now 1781824824958139 us; error 40 us; skew 500 ppm
I20260618 23:20:24.959450 13378 webserver.cc:460] Webserver started at http://127.3.217.130:34713/ using document root <none> and password file <none>
I20260618 23:20:24.959739 13378 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:24.959854 13378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:24.959982 13378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:20:24.961259 13378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "1db5eb30c1bc4f89b0cb144a3d0cb4f9"
format_stamp: "Formatted at 2026-06-18 23:20:24 on dist-test-slave-r9ct"
server_key: "2e2ce9355b90842ef9a526630b036ed6"
server_key_iv: "70282d04cfede5170b2a4599d75ec1d4"
server_key_version: "encryptionkey@0"
I20260618 23:20:24.961566 13378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "1db5eb30c1bc4f89b0cb144a3d0cb4f9"
format_stamp: "Formatted at 2026-06-18 23:20:24 on dist-test-slave-r9ct"
server_key: "2e2ce9355b90842ef9a526630b036ed6"
server_key_iv: "70282d04cfede5170b2a4599d75ec1d4"
server_key_version: "encryptionkey@0"
I20260618 23:20:24.963563 13378 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.002s
I20260618 23:20:24.964576 13392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:24.965101 13378 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:24.965224 13378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "1db5eb30c1bc4f89b0cb144a3d0cb4f9"
format_stamp: "Formatted at 2026-06-18 23:20:24 on dist-test-slave-r9ct"
server_key: "2e2ce9355b90842ef9a526630b036ed6"
server_key_iv: "70282d04cfede5170b2a4599d75ec1d4"
server_key_version: "encryptionkey@0"
I20260618 23:20:24.965313 13378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:24.982256 13378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:24.982574 13378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:24.982774 13378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:24.983026 13378 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:20:24.983433 13378 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:20:24.983494 13378 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:24.983531 13378 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:20:24.983575 13378 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:24.990895 13378 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:44749
I20260618 23:20:24.990950 13505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:44749 every 8 connection(s)
I20260618 23:20:24.991259 13378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:20:24.996626 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 13378
I20260618 23:20:24.996723 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:20:24.996938 3942 external_mini_cluster.cc:1428] Setting key 0406c31f71baae04d38f0c49212944fc
I20260618 23:20:24.997056 13227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:24.992071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:32771 (local address 127.3.217.190:34799)
0618 23:20:24.992132 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:24.992135 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:24.992268 (+ 133us) server_negotiation.cc:407] Connection header received
0618 23:20:24.992759 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:24.992760 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:24.992770 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:24.992835 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:24.993763 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:24.994279 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:24.995284 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:24.995487 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:24.995561 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:24.996747 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:24.996749 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:24.996749 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:20:24.996755 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:24.996771 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:20:24.996775 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:24.996828 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:24.996931 (+ 103us) server_negotiation.cc:299] Negotiation successful
0618 23:20:24.996953 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260618 23:20:24.997277 13508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:24.991940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:34799 (local address 127.3.217.130:32771)
0618 23:20:24.992142 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:24.992182 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:24.992652 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:24.992911 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:24.992914 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:24.992923 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:24.993659 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:24.993664 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:24.994368 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:24.994369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:24.995206 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:24.995209 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:24.995644 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:24.995646 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:24.995840 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:24.996555 (+ 715us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:20:24.996555 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:24.996599 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:20:24.996630 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:24.996848 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:24.996854 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:24.996857 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:20:24.996928 (+ 71us) client_negotiation.cc:240] Negotiation successful
0618 23:20:24.997051 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":108,"threads_started":1}
I20260618 23:20:24.997761 13506 heartbeater.cc:347] Connected to a master server at 127.3.217.190:34799
I20260618 23:20:24.997864 13506 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:24.998026 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34799
--builtin_ntp_servers=127.3.217.148:37797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260618 23:20:24.998059 13506 heartbeater.cc:511] Master 127.3.217.190:34799 requested a full tablet report, sending...
I20260618 23:20:24.998409 13186 ts_manager.cc:194] Registered new tserver with Master: 1db5eb30c1bc4f89b0cb144a3d0cb4f9 (127.3.217.130:44749)
I20260618 23:20:24.998854 13186 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.217.130:32771
W20260618 23:20:25.081025 13509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:25.081247 13509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:25.081271 13509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:25.082654 13509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:25.082695 13509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:25.082741 13509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:20:25.084477 13509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:37797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34799
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:25.084764 13509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:25.085119 13509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:25.091207 13514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:25.091250 13517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:25.091207 13515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:25.091550 13509 server_base.cc:1034] running on GCE node
I20260618 23:20:25.091917 13509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:25.092250 13509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:25.093452 13509 hybrid_clock.cc:648] HybridClock initialized: now 1781824825093425 us; error 37 us; skew 500 ppm
I20260618 23:20:25.095074 13509 webserver.cc:460] Webserver started at http://127.3.217.131:34641/ using document root <none> and password file <none>
I20260618 23:20:25.095341 13509 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:25.095412 13509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:25.095562 13509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:20:25.096647 13509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "4c0b97472e3a42149d7d7c7e15a37724"
format_stamp: "Formatted at 2026-06-18 23:20:25 on dist-test-slave-r9ct"
server_key: "e90e79feeffdf36f0a50e7852174d92c"
server_key_iv: "7ea480edb826b7ea62b8fa79dace399a"
server_key_version: "encryptionkey@0"
I20260618 23:20:25.097051 13509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "4c0b97472e3a42149d7d7c7e15a37724"
format_stamp: "Formatted at 2026-06-18 23:20:25 on dist-test-slave-r9ct"
server_key: "e90e79feeffdf36f0a50e7852174d92c"
server_key_iv: "7ea480edb826b7ea62b8fa79dace399a"
server_key_version: "encryptionkey@0"
I20260618 23:20:25.098629 13509 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260618 23:20:25.099704 13523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:25.099916 13509 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:20:25.100040 13509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "4c0b97472e3a42149d7d7c7e15a37724"
format_stamp: "Formatted at 2026-06-18 23:20:25 on dist-test-slave-r9ct"
server_key: "e90e79feeffdf36f0a50e7852174d92c"
server_key_iv: "7ea480edb826b7ea62b8fa79dace399a"
server_key_version: "encryptionkey@0"
I20260618 23:20:25.100174 13509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:25.121244 13509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:25.121552 13509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:25.121701 13509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:25.121927 13509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:20:25.122247 13509 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:20:25.122303 13509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:25.122346 13509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:20:25.122375 13509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:25.128366 13509 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:41795
I20260618 23:20:25.128516 13636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:41795 every 8 connection(s)
I20260618 23:20:25.128851 13509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:20:25.133399 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 13509
I20260618 23:20:25.133482 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:20:25.133760 3942 external_mini_cluster.cc:1428] Setting key c32453d4c5d7d945207acdaf0b5ef306
I20260618 23:20:25.134927 13227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:25.129679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:34657 (local address 127.3.217.190:34799)
0618 23:20:25.129740 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:25.129743 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:25.129945 (+ 202us) server_negotiation.cc:407] Connection header received
0618 23:20:25.130493 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:25.130496 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:25.130511 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:25.130605 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:25.131438 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:25.131966 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:25.133192 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:25.133630 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:25.133704 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:25.134663 (+ 959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:25.134664 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:25.134665 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:20:25.134669 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:25.134685 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:20:25.134689 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:25.134775 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:25.134846 (+ 71us) server_negotiation.cc:299] Negotiation successful
0618 23:20:25.134872 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260618 23:20:25.135181 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:25.129595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:34799 (local address 127.3.217.131:34657)
0618 23:20:25.129830 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:25.129871 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:25.130349 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:25.130699 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:25.130703 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:25.130775 (+ 72us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:25.131315 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:25.131320 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:25.132119 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:25.132120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:25.133086 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:25.133088 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:25.133749 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:25.133751 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:25.133906 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:25.134510 (+ 604us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:20:25.134510 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:25.134547 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:20:25.134575 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:25.134781 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:25.134790 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:25.134793 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:20:25.134844 (+ 51us) client_negotiation.cc:240] Negotiation successful
0618 23:20:25.134920 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":110,"threads_started":1}
I20260618 23:20:25.135720 13637 heartbeater.cc:347] Connected to a master server at 127.3.217.190:34799
I20260618 23:20:25.135807 13637 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:25.135937 13637 heartbeater.cc:511] Master 127.3.217.190:34799 requested a full tablet report, sending...
I20260618 23:20:25.136302 13186 ts_manager.cc:194] Registered new tserver with Master: 4c0b97472e3a42149d7d7c7e15a37724 (127.3.217.131:41795)
I20260618 23:20:25.136641 13186 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.217.131:34657
I20260618 23:20:25.145884 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260618 23:20:25.148046 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 13247
W20260618 23:20:25.148089 13227 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:25.147449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60176 (local address 127.3.217.190:34799)
0618 23:20:25.147583 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:25.147585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:25.147596 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:20:25.147638 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:25.147639 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:25.147654 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:25.147724 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:25.147998 (+ 274us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60176: BlockingRecv error: recv got EOF from 127.0.0.1:60176 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
I20260618 23:20:25.152443 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 13378
I20260618 23:20:25.156214 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 13509
I20260618 23:20:25.160712 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 13156
2026-06-18T23:20:25Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (631 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-06-18T23:20:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:20:25Z Disabled control of system clock
I20260618 23:20:25.189666 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:34381
--webserver_interface=127.3.217.190
--webserver_port=0
--builtin_ntp_servers=127.3.217.148:40783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:34381
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260618 23:20:25.280908 13648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:25.281148 13648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:25.281170 13648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:25.282274 13648 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:20:25.282312 13648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:25.282325 13648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:25.282337 13648 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:20:25.282351 13648 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:20:25.283651 13648 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:40783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:34381
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:34381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:25.283857 13648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:25.284106 13648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:25.289548 13653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:25.289543 13656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:25.289682 13654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:25.290241 13648 server_base.cc:1034] running on GCE node
I20260618 23:20:25.290575 13648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:25.290941 13648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:25.292140 13648 hybrid_clock.cc:648] HybridClock initialized: now 1781824825292127 us; error 31 us; skew 500 ppm
I20260618 23:20:25.293522 13648 webserver.cc:460] Webserver started at http://127.3.217.190:33637/ using document root <none> and password file <none>
I20260618 23:20:25.293766 13648 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:25.293839 13648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:25.293995 13648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:20:25.295272 13648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "38853c2bf8eb41f3a934ce14ac269388"
format_stamp: "Formatted at 2026-06-18 23:20:25 on dist-test-slave-r9ct"
server_key: "aaef5a4a8a2e0664ea70958be009fd91"
server_key_iv: "2a2999a5447af9482f57620ed7270fb0"
server_key_version: "encryptionkey@0"
I20260618 23:20:25.295760 13648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "38853c2bf8eb41f3a934ce14ac269388"
format_stamp: "Formatted at 2026-06-18 23:20:25 on dist-test-slave-r9ct"
server_key: "aaef5a4a8a2e0664ea70958be009fd91"
server_key_iv: "2a2999a5447af9482f57620ed7270fb0"
server_key_version: "encryptionkey@0"
I20260618 23:20:25.297130 13648 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260618 23:20:25.298113 13662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:25.298413 13648 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:25.298542 13648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "38853c2bf8eb41f3a934ce14ac269388"
format_stamp: "Formatted at 2026-06-18 23:20:25 on dist-test-slave-r9ct"
server_key: "aaef5a4a8a2e0664ea70958be009fd91"
server_key_iv: "2a2999a5447af9482f57620ed7270fb0"
server_key_version: "encryptionkey@0"
I20260618 23:20:25.298622 13648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:25.302006 13648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:25.302276 13648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:25.302416 13648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:25.308435 13648 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:34381
I20260618 23:20:25.308475 13714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:34381 every 8 connection(s)
I20260618 23:20:25.308936 13648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:20:25.309770 13715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:25.312764 13715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388: Bootstrap starting.
I20260618 23:20:25.313452 13715 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:25.313783 13715 log.cc:824] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388: Log is configured to *not* fsync() on all Append() calls
I20260618 23:20:25.314785 13715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388: No bootstrap required, opened a new log
I20260618 23:20:25.315857 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 13648
I20260618 23:20:25.315944 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:20:25.316197 3942 external_mini_cluster.cc:1428] Setting key 80c57060a0042c4ec05abfa1ca23d7bb
I20260618 23:20:25.317386 13715 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38853c2bf8eb41f3a934ce14ac269388" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34381 } }
I20260618 23:20:25.317699 13715 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:25.317744 13715 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38853c2bf8eb41f3a934ce14ac269388, State: Initialized, Role: FOLLOWER
I20260618 23:20:25.317925 13715 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38853c2bf8eb41f3a934ce14ac269388" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34381 } }
I20260618 23:20:25.318056 13715 raft_consensus.cc:388] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:20:25.318099 13715 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:20:25.318152 13715 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:25.319044 13719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:25.316982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33522 (local address 127.3.217.190:34381)
0618 23:20:25.317186 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:25.317194 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:25.317225 (+ 31us) server_negotiation.cc:407] Connection header received
0618 23:20:25.317339 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:25.317344 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:25.317379 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:25.317572 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:25.318246 (+ 674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:25.318249 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:25.318249 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:20:25.318254 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:25.318297 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:20:25.318313 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:25.318393 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:25.318470 (+ 77us) server_negotiation.cc:299] Negotiation successful
0618 23:20:25.318525 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":93,"threads_started":1}
I20260618 23:20:25.319123 13715 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38853c2bf8eb41f3a934ce14ac269388" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34381 } }
I20260618 23:20:25.319216 13715 leader_election.cc:302] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 38853c2bf8eb41f3a934ce14ac269388; no voters:
I20260618 23:20:25.319360 13715 leader_election.cc:288] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:20:25.319466 13720 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:20:25.319631 13715 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:20:25.319653 13720 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388 [term 1 LEADER]: Becoming Leader. State: Replica: 38853c2bf8eb41f3a934ce14ac269388, State: Running, Role: LEADER
I20260618 23:20:25.319828 13720 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38853c2bf8eb41f3a934ce14ac269388" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34381 } }
I20260618 23:20:25.320210 13721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "38853c2bf8eb41f3a934ce14ac269388" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38853c2bf8eb41f3a934ce14ac269388" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34381 } } }
I20260618 23:20:25.320304 13721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388 [sys.catalog]: This master's current role is: LEADER
I20260618 23:20:25.320459 13722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38853c2bf8eb41f3a934ce14ac269388. Latest consensus state: current_term: 1 leader_uuid: "38853c2bf8eb41f3a934ce14ac269388" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38853c2bf8eb41f3a934ce14ac269388" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34381 } } }
I20260618 23:20:25.320516 13729 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:20:25.320533 13722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388 [sys.catalog]: This master's current role is: LEADER
I20260618 23:20:25.321105 13729 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:20:25.322783 13729 catalog_manager.cc:1347] Generated new cluster ID: a75bcb6b07f640f29473a39896c1d29a
I20260618 23:20:25.322841 13729 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:20:25.340160 13729 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:20:25.340515 13729 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:20:25.347363 13729 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38853c2bf8eb41f3a934ce14ac269388: Generated new TSK 0
I20260618 23:20:25.347681 13729 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:20:25.353281 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34381
--builtin_ntp_servers=127.3.217.148:40783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260618 23:20:25.444424 13739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:25.444648 13739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:25.444675 13739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:25.446498 13739 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:25.446583 13739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:25.446630 13739 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:20:25.449772 13739 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:40783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13739
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:25.450126 13739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:25.450446 13739 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:25.456380 13745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:25.456508 13739 server_base.cc:1034] running on GCE node
W20260618 23:20:25.456352 13747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:25.456372 13744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:25.456913 13739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:25.457209 13739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:25.458432 13739 hybrid_clock.cc:648] HybridClock initialized: now 1781824825458409 us; error 38 us; skew 500 ppm
I20260618 23:20:25.460057 13739 webserver.cc:460] Webserver started at http://127.3.217.129:37559/ using document root <none> and password file <none>
I20260618 23:20:25.460350 13739 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:25.460428 13739 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:25.460602 13739 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:20:25.461782 13739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "892fb628af664316a7579ed6f6fbe570"
format_stamp: "Formatted at 2026-06-18 23:20:25 on dist-test-slave-r9ct"
server_key: "41358c3271f0c11986e7958b00b70646"
server_key_iv: "5e5bf9a57f46b6817d08bb839cab23a4"
server_key_version: "encryptionkey@0"
I20260618 23:20:25.462181 13739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "892fb628af664316a7579ed6f6fbe570"
format_stamp: "Formatted at 2026-06-18 23:20:25 on dist-test-slave-r9ct"
server_key: "41358c3271f0c11986e7958b00b70646"
server_key_iv: "5e5bf9a57f46b6817d08bb839cab23a4"
server_key_version: "encryptionkey@0"
I20260618 23:20:25.463836 13739 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260618 23:20:25.464931 13753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:25.465355 13739 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:25.465487 13739 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "892fb628af664316a7579ed6f6fbe570"
format_stamp: "Formatted at 2026-06-18 23:20:25 on dist-test-slave-r9ct"
server_key: "41358c3271f0c11986e7958b00b70646"
server_key_iv: "5e5bf9a57f46b6817d08bb839cab23a4"
server_key_version: "encryptionkey@0"
I20260618 23:20:25.465729 13739 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:25.470137 13739 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:25.470434 13739 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:25.470571 13739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:25.470816 13739 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:20:25.471212 13739 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:20:25.471274 13739 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:25.471307 13739 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:20:25.471334 13739 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:25.477834 13739 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:38447
I20260618 23:20:25.477869 13866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:38447 every 8 connection(s)
I20260618 23:20:25.478214 13739 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:20:25.479401 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 13739
I20260618 23:20:25.479512 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:20:25.479730 3942 external_mini_cluster.cc:1428] Setting key 6b1fa6185bdaeb33accdbfa12a9d2c6c
I20260618 23:20:25.480903 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34381
--builtin_ntp_servers=127.3.217.148:40783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260618 23:20:25.483453 13719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:25.479094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:47941 (local address 127.3.217.190:34381)
0618 23:20:25.479183 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:25.479185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:25.479435 (+ 250us) server_negotiation.cc:407] Connection header received
0618 23:20:25.480616 (+ 1181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:25.480617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:25.480623 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:25.480670 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:25.482894 (+ 2224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:25.482896 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:25.482897 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:20:25.482906 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:25.482938 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:20:25.482946 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:25.483061 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:25.483311 (+ 250us) server_negotiation.cc:299] Negotiation successful
0618 23:20:25.483330 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260618 23:20:25.483757 13869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:25.479045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:34381 (local address 127.3.217.129:47941)
0618 23:20:25.479317 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:25.479351 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:25.480493 (+ 1142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:25.480751 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:25.480754 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:25.480762 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:25.482589 (+ 1827us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:20:25.482589 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:25.482616 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:20:25.482642 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:25.483135 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:25.483170 (+ 35us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:25.483175 (+ 5us) client_negotiation.cc:769] Sending connection context
0618 23:20:25.483314 (+ 139us) client_negotiation.cc:240] Negotiation successful
0618 23:20:25.483394 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":130,"threads_started":1}
I20260618 23:20:25.484527 13867 heartbeater.cc:347] Connected to a master server at 127.3.217.190:34381
I20260618 23:20:25.484655 13867 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:25.484833 13867 heartbeater.cc:511] Master 127.3.217.190:34381 requested a full tablet report, sending...
I20260618 23:20:25.485755 13679 ts_manager.cc:194] Registered new tserver with Master: 892fb628af664316a7579ed6f6fbe570 (127.3.217.129:38447)
W20260618 23:20:25.569583 13870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:25.569773 13870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:25.569795 13870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:25.570993 13870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:25.571041 13870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:25.571067 13870 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:20:25.572316 13870 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:40783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:25.572564 13870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:25.572835 13870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:25.578119 13878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:25.578084 13876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:25.578084 13875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:25.578233 13870 server_base.cc:1034] running on GCE node
I20260618 23:20:25.578523 13870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:25.578790 13870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:25.579962 13870 hybrid_clock.cc:648] HybridClock initialized: now 1781824825579942 us; error 38 us; skew 500 ppm
I20260618 23:20:25.581687 13870 webserver.cc:460] Webserver started at http://127.3.217.130:38825/ using document root <none> and password file <none>
I20260618 23:20:25.582000 13870 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:25.582053 13870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:25.582166 13870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:20:25.583431 13870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "3d5a114047b043d3948f8d71e633f5a9"
format_stamp: "Formatted at 2026-06-18 23:20:25 on dist-test-slave-r9ct"
server_key: "d87e89bc2071ebe878733af5a32235e5"
server_key_iv: "a90586dcc894d3f90c127fc12b32ebff"
server_key_version: "encryptionkey@0"
I20260618 23:20:25.583786 13870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "3d5a114047b043d3948f8d71e633f5a9"
format_stamp: "Formatted at 2026-06-18 23:20:25 on dist-test-slave-r9ct"
server_key: "d87e89bc2071ebe878733af5a32235e5"
server_key_iv: "a90586dcc894d3f90c127fc12b32ebff"
server_key_version: "encryptionkey@0"
I20260618 23:20:25.585438 13870 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260618 23:20:25.586408 13884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:25.586663 13870 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:25.586796 13870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "3d5a114047b043d3948f8d71e633f5a9"
format_stamp: "Formatted at 2026-06-18 23:20:25 on dist-test-slave-r9ct"
server_key: "d87e89bc2071ebe878733af5a32235e5"
server_key_iv: "a90586dcc894d3f90c127fc12b32ebff"
server_key_version: "encryptionkey@0"
I20260618 23:20:25.586905 13870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:25.591341 13870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:25.591656 13870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:25.591766 13870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:25.592031 13870 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:20:25.592397 13870 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:20:25.592440 13870 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:25.592463 13870 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:20:25.592474 13870 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:25.599761 13870 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:35571
I20260618 23:20:25.599810 13997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:35571 every 8 connection(s)
I20260618 23:20:25.600142 13870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:20:25.603883 13719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:25.601079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:43203 (local address 127.3.217.190:34381)
0618 23:20:25.601170 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:25.601172 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:25.601394 (+ 222us) server_negotiation.cc:407] Connection header received
0618 23:20:25.602187 (+ 793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:25.602188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:25.602193 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:25.602279 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:25.603661 (+ 1382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:25.603662 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:25.603662 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:20:25.603666 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:25.603682 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:20:25.603686 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:25.603747 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:25.603813 (+ 66us) server_negotiation.cc:299] Negotiation successful
0618 23:20:25.603826 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260618 23:20:25.604111 14000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:25.600987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:34381 (local address 127.3.217.130:43203)
0618 23:20:25.601224 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:25.601270 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:25.602014 (+ 744us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:25.602354 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:25.602358 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:25.602367 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:25.603481 (+ 1114us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:20:25.603482 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:25.603521 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:20:25.603556 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:25.603748 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:25.603751 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:25.603753 (+ 2us) client_negotiation.cc:769] Sending connection context
0618 23:20:25.603808 (+ 55us) client_negotiation.cc:240] Negotiation successful
0618 23:20:25.603859 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":110,"threads_started":1}
I20260618 23:20:25.604858 13998 heartbeater.cc:347] Connected to a master server at 127.3.217.190:34381
I20260618 23:20:25.604959 13998 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:25.605144 13998 heartbeater.cc:511] Master 127.3.217.190:34381 requested a full tablet report, sending...
I20260618 23:20:25.605865 13679 ts_manager.cc:194] Registered new tserver with Master: 3d5a114047b043d3948f8d71e633f5a9 (127.3.217.130:35571)
I20260618 23:20:25.608389 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 13870
I20260618 23:20:25.608489 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:20:25.608668 3942 external_mini_cluster.cc:1428] Setting key f254a3960a5bc1c2525910df89081fcf
I20260618 23:20:25.609551 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34381
--builtin_ntp_servers=127.3.217.148:40783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260618 23:20:25.688982 14001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:25.689185 14001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:25.689208 14001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:25.690268 14001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:25.690308 14001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:25.690333 14001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:20:25.692612 14001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:40783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:25.692972 14001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:25.693351 14001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:25.699406 14006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:25.699750 14007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:25.699865 14009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:25.699887 14001 server_base.cc:1034] running on GCE node
I20260618 23:20:25.700265 14001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:25.700570 14001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:25.701777 14001 hybrid_clock.cc:648] HybridClock initialized: now 1781824825701767 us; error 34 us; skew 500 ppm
I20260618 23:20:25.703234 14001 webserver.cc:460] Webserver started at http://127.3.217.131:38339/ using document root <none> and password file <none>
I20260618 23:20:25.703511 14001 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:25.703584 14001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:25.703732 14001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:20:25.704838 14001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "513b3af18f8a48a8a076bb938f67a280"
format_stamp: "Formatted at 2026-06-18 23:20:25 on dist-test-slave-r9ct"
server_key: "d539dc7076d5d34d1ed87e36698d3cbc"
server_key_iv: "7023c073e7103d54a566c1fa714004a6"
server_key_version: "encryptionkey@0"
I20260618 23:20:25.705189 14001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "513b3af18f8a48a8a076bb938f67a280"
format_stamp: "Formatted at 2026-06-18 23:20:25 on dist-test-slave-r9ct"
server_key: "d539dc7076d5d34d1ed87e36698d3cbc"
server_key_iv: "7023c073e7103d54a566c1fa714004a6"
server_key_version: "encryptionkey@0"
I20260618 23:20:25.707180 14001 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260618 23:20:25.708166 14015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:25.708485 14001 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:25.708606 14001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "513b3af18f8a48a8a076bb938f67a280"
format_stamp: "Formatted at 2026-06-18 23:20:25 on dist-test-slave-r9ct"
server_key: "d539dc7076d5d34d1ed87e36698d3cbc"
server_key_iv: "7023c073e7103d54a566c1fa714004a6"
server_key_version: "encryptionkey@0"
I20260618 23:20:25.708684 14001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:25.712098 14001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:25.712368 14001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:25.712515 14001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:25.712728 14001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:20:25.713024 14001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:20:25.713081 14001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:25.713119 14001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:20:25.713146 14001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:25.719427 14001 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:33973
I20260618 23:20:25.719461 14128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:33973 every 8 connection(s)
I20260618 23:20:25.719849 14001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:20:25.724035 13719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:25.721115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:52361 (local address 127.3.217.190:34381)
0618 23:20:25.721183 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:25.721185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:25.721409 (+ 224us) server_negotiation.cc:407] Connection header received
0618 23:20:25.722192 (+ 783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:25.722193 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:25.722200 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:25.722260 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:25.723695 (+ 1435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:25.723696 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:25.723696 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:20:25.723700 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:25.723713 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:20:25.723717 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:25.723775 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:25.723968 (+ 193us) server_negotiation.cc:299] Negotiation successful
0618 23:20:25.723983 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260618 23:20:25.724388 14131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:25.721076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:34381 (local address 127.3.217.131:52361)
0618 23:20:25.721277 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:25.721318 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:25.722059 (+ 741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:25.722428 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:25.722433 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:25.722445 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:25.723521 (+ 1076us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:20:25.723521 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:25.723554 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:20:25.723591 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:25.723857 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:25.723863 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:25.723866 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:20:25.723961 (+ 95us) client_negotiation.cc:240] Negotiation successful
0618 23:20:25.724025 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":112,"threads_started":1}
I20260618 23:20:25.724890 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 14001
I20260618 23:20:25.724996 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:20:25.725054 14129 heartbeater.cc:347] Connected to a master server at 127.3.217.190:34381
I20260618 23:20:25.725184 14129 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:25.725234 3942 external_mini_cluster.cc:1428] Setting key ff13f65a5cfff96734f2541c43a71696
I20260618 23:20:25.725342 14129 heartbeater.cc:511] Master 127.3.217.190:34381 requested a full tablet report, sending...
I20260618 23:20:25.725900 13679 ts_manager.cc:194] Registered new tserver with Master: 513b3af18f8a48a8a076bb938f67a280 (127.3.217.131:33973)
I20260618 23:20:25.726647 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260618 23:20:25.728578 13719 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:20:25.728165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33534 (local address 127.3.217.190:34381)
0618 23:20:25.728267 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:25.728269 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:25.728348 (+ 79us) server_negotiation.cc:407] Connection header received
0618 23:20:25.728402 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:25.728403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:25.728407 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:25.728452 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:25.728537 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33534: BlockingRecv error: recv got EOF from 127.0.0.1:33534 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
I20260618 23:20:25.728693 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 13739
I20260618 23:20:25.733680 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 13870
I20260618 23:20:25.737890 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 14001
I20260618 23:20:25.742385 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 13648
2026-06-18T23:20:25Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (580 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:20:25 dist-test-slave-r9ct krb5kdc[14139](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:20:25 dist-test-slave-r9ct krb5kdc[14139](info): set up 2 sockets
Jun 18 23:20:25 dist-test-slave-r9ct krb5kdc[14139](info): commencing operation
krb5kdc: starting...
W20260618 23:20:26.835831 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.074s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:20:26 dist-test-slave-r9ct krb5kdc[14139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:20:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:20:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:20:26.972726 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:44437
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:37953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:44437
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:20:27.056344 14152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:27.056555 14152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:27.056577 14152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:27.057639 14152 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:20:27.057677 14152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:27.057690 14152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:27.057703 14152 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:20:27.057714 14152 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:20:27.059108 14152 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:37953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:44437
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:44437
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:27.059294 14152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:27.059463 14152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:27.065269 14160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:27.065304 14157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:27.065354 14152 server_base.cc:1034] running on GCE node
W20260618 23:20:27.065315 14158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:27.065863 14152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:27.066339 14152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:27.067533 14152 hybrid_clock.cc:648] HybridClock initialized: now 1781824827067531 us; error 61 us; skew 500 ppm
Jun 18 23:20:27 dist-test-slave-r9ct krb5kdc[14139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824827, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:20:27.070407 14152 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:20:27.070966 14152 webserver.cc:460] Webserver started at http://127.3.217.190:46355/ using document root <none> and password file <none>
I20260618 23:20:27.071255 14152 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:27.071307 14152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:27.071425 14152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:20:27.072494 14152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "37a6f277840d40c98e5fbbaa9275801a"
format_stamp: "Formatted at 2026-06-18 23:20:27 on dist-test-slave-r9ct"
server_key: "0ed95a4deb0324c74cc56aa6b9c11752"
server_key_iv: "e7a47d5c4e778d47d909c8bcccdcd008"
server_key_version: "encryptionkey@0"
I20260618 23:20:27.072875 14152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "37a6f277840d40c98e5fbbaa9275801a"
format_stamp: "Formatted at 2026-06-18 23:20:27 on dist-test-slave-r9ct"
server_key: "0ed95a4deb0324c74cc56aa6b9c11752"
server_key_iv: "e7a47d5c4e778d47d909c8bcccdcd008"
server_key_version: "encryptionkey@0"
I20260618 23:20:27.074226 14152 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:20:27.075059 14167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:27.075251 14152 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:27.075351 14152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "37a6f277840d40c98e5fbbaa9275801a"
format_stamp: "Formatted at 2026-06-18 23:20:27 on dist-test-slave-r9ct"
server_key: "0ed95a4deb0324c74cc56aa6b9c11752"
server_key_iv: "e7a47d5c4e778d47d909c8bcccdcd008"
server_key_version: "encryptionkey@0"
I20260618 23:20:27.075429 14152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:27.103018 14152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:27.105334 14152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:27.105616 14152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:27.110069 14152 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:44437
I20260618 23:20:27.110109 14219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:44437 every 8 connection(s)
I20260618 23:20:27.110536 14152 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:20:27.111574 14220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:27.114355 14220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a: Bootstrap starting.
I20260618 23:20:27.114990 14220 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:27.115270 14220 log.cc:824] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a: Log is configured to *not* fsync() on all Append() calls
I20260618 23:20:27.115938 14220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a: No bootstrap required, opened a new log
I20260618 23:20:27.117501 14220 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37a6f277840d40c98e5fbbaa9275801a" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 44437 } }
I20260618 23:20:27.117660 14220 raft_consensus.cc:374] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:27.117707 14220 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37a6f277840d40c98e5fbbaa9275801a, State: Initialized, Role: FOLLOWER
I20260618 23:20:27.117873 14220 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37a6f277840d40c98e5fbbaa9275801a" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 44437 } }
I20260618 23:20:27.117964 14220 raft_consensus.cc:388] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:20:27.118006 14220 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:20:27.118065 14220 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:27.118881 14220 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37a6f277840d40c98e5fbbaa9275801a" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 44437 } }
I20260618 23:20:27.118999 14220 leader_election.cc:302] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 37a6f277840d40c98e5fbbaa9275801a; no voters:
I20260618 23:20:27.119205 14220 leader_election.cc:288] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:20:27.119226 14223 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:20:27.119359 14223 raft_consensus.cc:686] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a [term 1 LEADER]: Becoming Leader. State: Replica: 37a6f277840d40c98e5fbbaa9275801a, State: Running, Role: LEADER
I20260618 23:20:27.119486 14220 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:20:27.119454 14223 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37a6f277840d40c98e5fbbaa9275801a" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 44437 } }
I20260618 23:20:27.119709 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 14152
I20260618 23:20:27.119802 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:20:27.119910 14224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "37a6f277840d40c98e5fbbaa9275801a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37a6f277840d40c98e5fbbaa9275801a" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 44437 } } }
I20260618 23:20:27.120019 3942 external_mini_cluster.cc:1428] Setting key 24f37067c1290eed66ef408c93eb3d78
I20260618 23:20:27.120311 14224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a [sys.catalog]: This master's current role is: LEADER
I20260618 23:20:27.120201 14225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37a6f277840d40c98e5fbbaa9275801a. Latest consensus state: current_term: 1 leader_uuid: "37a6f277840d40c98e5fbbaa9275801a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37a6f277840d40c98e5fbbaa9275801a" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 44437 } } }
I20260618 23:20:27.120680 14225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a [sys.catalog]: This master's current role is: LEADER
W20260618 23:20:27.121546 14241 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260618 23:20:27.121618 14241 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260618 23:20:27.121697 14232 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:20:27.121873 14232 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:20:27.123456 14232 catalog_manager.cc:1347] Generated new cluster ID: b4bf92668a334ffeb6aa890bc4c94151
I20260618 23:20:27.123507 14232 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 18 23:20:27 dist-test-slave-r9ct krb5kdc[14139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:20:27.132483 14235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:27.120560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48184 (local address 127.3.217.190:44437)
0618 23:20:27.120838 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:27.120845 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:27.120868 (+ 23us) server_negotiation.cc:407] Connection header received
0618 23:20:27.120960 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:27.120964 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:27.121006 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:27.121150 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:27.122024 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.123334 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.124490 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.125068 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.125165 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:27.128023 (+ 2858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:27.128027 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:27.128028 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:27.128039 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:27.130666 (+ 2627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:27.131080 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:27.131083 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:27.131084 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:27.131203 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:27.131403 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:27.131403 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:27.131404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:27.131740 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:27.131892 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:27.131968 (+ 76us) server_negotiation.cc:299] Negotiation successful
0618 23:20:27.132241 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":58,"threads_started":1}
I20260618 23:20:27.133777 14232 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:20:27.134509 14232 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:20:27.142911 14232 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a: Generated new TSK 0
I20260618 23:20:27.143105 14232 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.217.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
I20260618 23:20:27.179442 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:44437
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:37953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:20:27.265545 14246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:27.265739 14246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:27.265762 14246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:27.266919 14246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:27.266963 14246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:27.266988 14246 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:20:27.268375 14246 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:37953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:44437
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14246
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:27.268556 14246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:27.268730 14246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:27.273787 14251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:27.273787 14254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:27.273813 14252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:27.274343 14246 server_base.cc:1034] running on GCE node
I20260618 23:20:27.274619 14246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:27.274938 14246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:27.276185 14246 hybrid_clock.cc:648] HybridClock initialized: now 1781824827276160 us; error 68 us; skew 500 ppm
Jun 18 23:20:27 dist-test-slave-r9ct krb5kdc[14139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824827, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:20:27.279503 14246 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:20:27.280615 14246 webserver.cc:460] Webserver started at http://127.3.217.129:33495/ using document root <none> and password file <none>
I20260618 23:20:27.280906 14246 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:27.280961 14246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:27.281102 14246 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:20:27.282229 14246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "8a08ef0f56be4ce495d0b4f432be9c3f"
format_stamp: "Formatted at 2026-06-18 23:20:27 on dist-test-slave-r9ct"
server_key: "9e53d02f47ed8577d7c7d46efdc3dfd2"
server_key_iv: "db12470c99ec66ddc25a371080c91fd1"
server_key_version: "encryptionkey@0"
I20260618 23:20:27.282747 14246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "8a08ef0f56be4ce495d0b4f432be9c3f"
format_stamp: "Formatted at 2026-06-18 23:20:27 on dist-test-slave-r9ct"
server_key: "9e53d02f47ed8577d7c7d46efdc3dfd2"
server_key_iv: "db12470c99ec66ddc25a371080c91fd1"
server_key_version: "encryptionkey@0"
I20260618 23:20:27.284446 14246 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260618 23:20:27.285527 14261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:27.285768 14246 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:27.285890 14246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "8a08ef0f56be4ce495d0b4f432be9c3f"
format_stamp: "Formatted at 2026-06-18 23:20:27 on dist-test-slave-r9ct"
server_key: "9e53d02f47ed8577d7c7d46efdc3dfd2"
server_key_iv: "db12470c99ec66ddc25a371080c91fd1"
server_key_version: "encryptionkey@0"
I20260618 23:20:27.285972 14246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:27.300565 14246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:27.303081 14246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:27.303249 14246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:27.303505 14246 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:20:27.303808 14246 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:20:27.303861 14246 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:27.303901 14246 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:20:27.303930 14246 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:27.309582 14246 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:39115
I20260618 23:20:27.309626 14374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:39115 every 8 connection(s)
I20260618 23:20:27.309945 14246 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:20:27.314456 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 14246
I20260618 23:20:27.314556 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:20:27.314791 3942 external_mini_cluster.cc:1428] Setting key b479fa056dc7af5dfdedfe44d7e9f5f8
Jun 18 23:20:27 dist-test-slave-r9ct krb5kdc[14139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824827, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:20:27.321300 14235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:27.311040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:43517 (local address 127.3.217.190:44437)
0618 23:20:27.311113 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:27.311116 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:27.311190 (+ 74us) server_negotiation.cc:407] Connection header received
0618 23:20:27.311731 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:27.311732 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:27.311742 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:27.311797 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:27.312763 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.313257 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.314334 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.314597 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.314690 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:27.317387 (+ 2697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:27.317388 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:27.317388 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:27.317395 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:27.319779 (+ 2384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:27.320246 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:27.320248 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:27.320248 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:27.320312 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:27.320568 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:27.320569 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:27.320570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:27.320722 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:27.320801 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:27.321061 (+ 260us) server_negotiation.cc:299] Negotiation successful
0618 23:20:27.321157 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260618 23:20:27.321321 14377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:27.310653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:44437 (local address 127.3.217.129:43517)
0618 23:20:27.311057 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:27.311106 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:27.311631 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:27.311922 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:27.311925 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:27.312468 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:27.312662 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:27.312667 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.313347 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.313348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:27.314215 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:27.314217 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.314732 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.314734 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:27.314884 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:27.315493 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:27.315607 (+ 114us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:27.317269 (+ 1662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:27.319903 (+ 2634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:27.319911 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:27.319917 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:27.320168 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:27.320387 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:27.320388 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:27.320388 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:27.320493 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:27.320807 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:27.320812 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:27.320926 (+ 114us) client_negotiation.cc:769] Sending connection context
0618 23:20:27.321017 (+ 91us) client_negotiation.cc:240] Negotiation successful
0618 23:20:27.321145 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":303,"threads_started":1}
I20260618 23:20:27.321976 14375 heartbeater.cc:347] Connected to a master server at 127.3.217.190:44437
I20260618 23:20:27.322091 14375 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:27.322280 14375 heartbeater.cc:511] Master 127.3.217.190:44437 requested a full tablet report, sending...
I20260618 23:20:27.322885 14184 ts_manager.cc:194] Registered new tserver with Master: 8a08ef0f56be4ce495d0b4f432be9c3f (127.3.217.129:39115)
I20260618 23:20:27.323812 14184 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:43517
WARNING: no policy specified for kudu/127.3.217.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
I20260618 23:20:27.346674 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:44437
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:37953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:20:27.431946 14380 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:27.432170 14380 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:27.432206 14380 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:27.433305 14380 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:27.433372 14380 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:27.433418 14380 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:20:27.435050 14380 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:37953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:44437
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14380
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:27.435322 14380 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:27.435562 14380 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:27.440712 14386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:27.440793 14388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:27.440819 14385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:27.440889 14380 server_base.cc:1034] running on GCE node
I20260618 23:20:27.441151 14380 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:27.441345 14380 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:27.442483 14380 hybrid_clock.cc:648] HybridClock initialized: now 1781824827442472 us; error 31 us; skew 500 ppm
Jun 18 23:20:27 dist-test-slave-r9ct krb5kdc[14139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824827, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:20:27.445082 14380 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:20:27.445569 14380 webserver.cc:460] Webserver started at http://127.3.217.130:43839/ using document root <none> and password file <none>
I20260618 23:20:27.445789 14380 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:27.445871 14380 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:27.446028 14380 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:20:27.447127 14380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "3c405958bcbf49548e9530cc3bebb23f"
format_stamp: "Formatted at 2026-06-18 23:20:27 on dist-test-slave-r9ct"
server_key: "2db9b2cd460e8de16464de035d5873b3"
server_key_iv: "a807889c006b42f337c5beccd0fb4197"
server_key_version: "encryptionkey@0"
I20260618 23:20:27.447477 14380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "3c405958bcbf49548e9530cc3bebb23f"
format_stamp: "Formatted at 2026-06-18 23:20:27 on dist-test-slave-r9ct"
server_key: "2db9b2cd460e8de16464de035d5873b3"
server_key_iv: "a807889c006b42f337c5beccd0fb4197"
server_key_version: "encryptionkey@0"
I20260618 23:20:27.448803 14380 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260618 23:20:27.449798 14395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:27.450150 14380 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:20:27.450273 14380 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "3c405958bcbf49548e9530cc3bebb23f"
format_stamp: "Formatted at 2026-06-18 23:20:27 on dist-test-slave-r9ct"
server_key: "2db9b2cd460e8de16464de035d5873b3"
server_key_iv: "a807889c006b42f337c5beccd0fb4197"
server_key_version: "encryptionkey@0"
I20260618 23:20:27.450354 14380 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:27.485088 14380 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:27.487324 14380 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:27.487488 14380 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:27.487740 14380 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:20:27.488057 14380 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:20:27.488111 14380 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:27.488145 14380 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:20:27.488173 14380 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:27.494971 14380 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:38243
I20260618 23:20:27.495018 14508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:38243 every 8 connection(s)
I20260618 23:20:27.495396 14380 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
Jun 18 23:20:27 dist-test-slave-r9ct krb5kdc[14139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824827, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:20:27.502954 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 14380
I20260618 23:20:27.503123 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:20:27.503328 3942 external_mini_cluster.cc:1428] Setting key 079398e76c24a7cb4e4ef42977725999
I20260618 23:20:27.506531 14235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:27.496213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:52043 (local address 127.3.217.190:44437)
0618 23:20:27.496300 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:27.496302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:27.496591 (+ 289us) server_negotiation.cc:407] Connection header received
0618 23:20:27.497116 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:27.497117 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:27.497128 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:27.497191 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:27.498238 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.498821 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.500041 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.500256 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.500329 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:27.503019 (+ 2690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:27.503021 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:27.503021 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:27.503029 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:27.504876 (+ 1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:27.505423 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:27.505425 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:27.505425 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:27.505496 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:27.505809 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:27.505810 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:27.505811 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:27.505946 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:27.506033 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:27.506335 (+ 302us) server_negotiation.cc:299] Negotiation successful
0618 23:20:27.506429 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260618 23:20:27.506809 14511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:27.496180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:44437 (local address 127.3.217.130:52043)
0618 23:20:27.496370 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:27.496412 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:27.496898 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:27.497288 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:27.497292 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:27.497936 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:27.498135 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:27.498139 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.498895 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.498896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:27.499909 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:27.499915 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.500379 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.500380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:27.500508 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:27.501232 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:27.501242 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:27.502900 (+ 1658us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:27.504976 (+ 2076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:27.504984 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:27.504987 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:27.505261 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:27.505585 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:27.505586 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:27.505586 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:27.505722 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:27.506035 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:27.506042 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:27.506191 (+ 149us) client_negotiation.cc:769] Sending connection context
0618 23:20:27.506312 (+ 121us) client_negotiation.cc:240] Negotiation successful
0618 23:20:27.506504 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":113,"threads_started":1}
I20260618 23:20:27.507357 14509 heartbeater.cc:347] Connected to a master server at 127.3.217.190:44437
I20260618 23:20:27.507475 14509 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:27.507655 14509 heartbeater.cc:511] Master 127.3.217.190:44437 requested a full tablet report, sending...
I20260618 23:20:27.508167 14184 ts_manager.cc:194] Registered new tserver with Master: 3c405958bcbf49548e9530cc3bebb23f (127.3.217.130:38243)
I20260618 23:20:27.508553 14184 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:52043
WARNING: no policy specified for kudu/127.3.217.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
I20260618 23:20:27.530367 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:44437
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:37953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:20:27.611723 14514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:20:27.611925 14514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:20:27.611948 14514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:20:27.613091 14514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:20:27.613133 14514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:20:27.613160 14514 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:20:27.614610 14514 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:37953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:44437
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:20:27.614923 14514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:20:27.615170 14514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:20:27.620452 14520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:27.620452 14519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:20:27.620895 14522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:20:27.621063 14514 server_base.cc:1034] running on GCE node
I20260618 23:20:27.621436 14514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:20:27.621737 14514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:20:27.622915 14514 hybrid_clock.cc:648] HybridClock initialized: now 1781824827622899 us; error 34 us; skew 500 ppm
Jun 18 23:20:27 dist-test-slave-r9ct krb5kdc[14139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824827, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:20:27.625479 14514 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:20:27.625957 14514 webserver.cc:460] Webserver started at http://127.3.217.131:44373/ using document root <none> and password file <none>
I20260618 23:20:27.626206 14514 fs_manager.cc:359] Metadata directory not provided
I20260618 23:20:27.626274 14514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:20:27.626416 14514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:20:27.627562 14514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "e59264d320bb4e938b9dc951897913b8"
format_stamp: "Formatted at 2026-06-18 23:20:27 on dist-test-slave-r9ct"
server_key: "e5526479c4c7dce48f558fbfbff214a9"
server_key_iv: "00845927a763068e6fa69ddbfc914722"
server_key_version: "encryptionkey@0"
I20260618 23:20:27.627907 14514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "e59264d320bb4e938b9dc951897913b8"
format_stamp: "Formatted at 2026-06-18 23:20:27 on dist-test-slave-r9ct"
server_key: "e5526479c4c7dce48f558fbfbff214a9"
server_key_iv: "00845927a763068e6fa69ddbfc914722"
server_key_version: "encryptionkey@0"
I20260618 23:20:27.629470 14514 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260618 23:20:27.630306 14529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:27.630641 14514 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:20:27.630883 14514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "e59264d320bb4e938b9dc951897913b8"
format_stamp: "Formatted at 2026-06-18 23:20:27 on dist-test-slave-r9ct"
server_key: "e5526479c4c7dce48f558fbfbff214a9"
server_key_iv: "00845927a763068e6fa69ddbfc914722"
server_key_version: "encryptionkey@0"
I20260618 23:20:27.631023 14514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:20:27.650619 14514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:20:27.652698 14514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:20:27.652861 14514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:20:27.653136 14514 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:20:27.653504 14514 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:20:27.653568 14514 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:27.653607 14514 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:20:27.653636 14514 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:20:27.659720 14514 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:41537
I20260618 23:20:27.659760 14642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:41537 every 8 connection(s)
I20260618 23:20:27.660080 14514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:20:27.665272 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 14514
I20260618 23:20:27.665401 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:20:27.665607 3942 external_mini_cluster.cc:1428] Setting key cf784e53eeedf6cea57fa59595d83e83
Jun 18 23:20:27 dist-test-slave-r9ct krb5kdc[14139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824827, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:20:27.671109 14235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:27.660820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:43209 (local address 127.3.217.190:44437)
0618 23:20:27.660862 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:27.660864 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:27.661063 (+ 199us) server_negotiation.cc:407] Connection header received
0618 23:20:27.661583 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:27.661584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:27.661594 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:27.661651 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:27.662526 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.663113 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.664474 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.664667 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.664757 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:27.668306 (+ 3549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:27.668307 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:27.668307 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:27.668314 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:27.669757 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:27.670175 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:27.670176 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:27.670177 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:27.670225 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:27.670465 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:27.670466 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:27.670466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:27.670573 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:27.670633 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:27.670955 (+ 322us) server_negotiation.cc:299] Negotiation successful
0618 23:20:27.671014 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260618 23:20:27.671325 14645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:27.660771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:44437 (local address 127.3.217.131:43209)
0618 23:20:27.660940 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:27.660980 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:27.661474 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:27.661703 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:27.661707 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:27.662244 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:20:27.662428 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:27.662431 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.663315 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.663316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:27.664329 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:27.664333 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.664819 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.664823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:27.664951 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:27.666004 (+ 1053us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:20:27.666019 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:20:27.668201 (+ 2182us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:20:27.669844 (+ 1643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:27.669849 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:27.669852 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:27.670104 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:27.670313 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:20:27.670313 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:20:27.670313 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:20:27.670408 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:20:27.670639 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:20:27.670643 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:20:27.670836 (+ 193us) client_negotiation.cc:769] Sending connection context
0618 23:20:27.670927 (+ 91us) client_negotiation.cc:240] Negotiation successful
0618 23:20:27.671069 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":88,"threads_started":1}
I20260618 23:20:27.671926 14643 heartbeater.cc:347] Connected to a master server at 127.3.217.190:44437
I20260618 23:20:27.672053 14643 heartbeater.cc:464] Registering TS with master...
I20260618 23:20:27.672233 14643 heartbeater.cc:511] Master 127.3.217.190:44437 requested a full tablet report, sending...
I20260618 23:20:27.672746 14184 ts_manager.cc:194] Registered new tserver with Master: e59264d320bb4e938b9dc951897913b8 (127.3.217.131:41537)
I20260618 23:20:27.673215 14184 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:43209
I20260618 23:20:27.678078 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260618 23:20:27.686650 14235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:27.679590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48200 (local address 127.3.217.190:44437)
0618 23:20:27.679636 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:27.679638 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:27.679885 (+ 247us) server_negotiation.cc:407] Connection header received
0618 23:20:27.679936 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:27.679937 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:27.679946 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:27.680031 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:20:27.680982 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.681511 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.682298 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.682545 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.682613 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:27.684011 (+ 1398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:20:27.684012 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:20:27.684013 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:20:27.684019 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:20:27.685438 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:27.685866 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:27.685867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:27.685868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:27.685923 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:20:27.686188 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:20:27.686189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:20:27.686189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:20:27.686324 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:20:27.686403 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:27.686524 (+ 121us) server_negotiation.cc:299] Negotiation successful
0618 23:20:27.686589 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260618 23:20:27.688639 14184 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48200:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:20:27.690320 14184 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:20:27.697074 14655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:27.692946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:41537 (local address 127.0.0.1:50588)
0618 23:20:27.693286 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:27.693297 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:27.693367 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:27.693574 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:27.693575 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:27.693577 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:27.693656 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:27.693658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.695100 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.695100 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:27.695965 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:27.695967 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.696849 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.696850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:27.696903 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:27.696905 (+ 2us) client_negotiation.cc:769] Sending connection context
0618 23:20:27.696957 (+ 52us) client_negotiation.cc:240] Negotiation successful
0618 23:20:27.696987 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":43,"threads_started":1}
I20260618 23:20:27.697177 14659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:27.693187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48178 (local address 127.3.217.129:39115)
0618 23:20:27.693496 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:27.693501 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:27.693509 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:20:27.693542 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:27.693544 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:27.693560 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:27.693641 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:27.693800 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.694526 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.696067 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.696597 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.696695 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:27.696754 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:27.697038 (+ 284us) server_negotiation.cc:299] Negotiation successful
0618 23:20:27.697086 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":71,"threads_started":1}
I20260618 23:20:27.697180 14654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:27.692940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:38243 (local address 127.0.0.1:50922)
0618 23:20:27.693087 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:27.693123 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:27.693188 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:27.693497 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:27.693500 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:27.693502 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:27.693570 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:27.693572 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.695031 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.695032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:27.696074 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:27.696075 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.696939 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.696940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:27.697003 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:27.697006 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:20:27.697056 (+ 50us) client_negotiation.cc:240] Negotiation successful
0618 23:20:27.697096 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":7,"thread_start_us":82,"threads_started":1}
I20260618 23:20:27.697096 14657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:27.693120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50588 (local address 127.3.217.131:41537)
0618 23:20:27.693330 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:27.693334 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:27.693344 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:20:27.693457 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:27.693459 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:27.693475 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:27.693733 (+ 258us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:27.693795 (+ 62us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.694968 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.696056 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.696734 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.696844 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:27.696898 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:27.696966 (+ 68us) server_negotiation.cc:299] Negotiation successful
0618 23:20:27.697004 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":87,"threads_started":1}
I20260618 23:20:27.696998 14656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:27.692962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:39115 (local address 127.0.0.1:48178)
0618 23:20:27.693333 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:27.693342 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:27.693383 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:27.693708 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:27.693708 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:27.693710 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:27.693740 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:27.693741 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.694631 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.694632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:27.695971 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:27.695973 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.696698 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.696699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:27.696772 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:27.696786 (+ 14us) client_negotiation.cc:769] Sending connection context
0618 23:20:27.696863 (+ 77us) client_negotiation.cc:240] Negotiation successful
0618 23:20:27.696914 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"mutex_wait_us":1,"thread_start_us":89,"threads_started":1}
I20260618 23:20:27.697487 14658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:27.693127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50922 (local address 127.3.217.130:38243)
0618 23:20:27.693329 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:27.693334 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:27.693344 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:20:27.693380 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:27.693382 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:27.693399 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:27.693490 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:27.693826 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.694928 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.696136 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.696806 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.696863 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:27.696907 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:27.697352 (+ 445us) server_negotiation.cc:299] Negotiation successful
0618 23:20:27.697399 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":86,"threads_started":1}
I20260618 23:20:27.698143 14577 tablet_service.cc:1467] Processing CreateTablet for tablet 6d19f88342f24607b835e3122c5089b9 (DEFAULT_TABLE table=test-table [id=5bd04c75cd4a46d0a0242674c9e7e73a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:20:27.698143 14309 tablet_service.cc:1467] Processing CreateTablet for tablet 6d19f88342f24607b835e3122c5089b9 (DEFAULT_TABLE table=test-table [id=5bd04c75cd4a46d0a0242674c9e7e73a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:20:27.698490 14577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d19f88342f24607b835e3122c5089b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:27.698490 14309 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d19f88342f24607b835e3122c5089b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:27.701840 14661 tablet_bootstrap.cc:492] T 6d19f88342f24607b835e3122c5089b9 P 8a08ef0f56be4ce495d0b4f432be9c3f: Bootstrap starting.
I20260618 23:20:27.702163 14443 tablet_service.cc:1467] Processing CreateTablet for tablet 6d19f88342f24607b835e3122c5089b9 (DEFAULT_TABLE table=test-table [id=5bd04c75cd4a46d0a0242674c9e7e73a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:20:27.702461 14443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d19f88342f24607b835e3122c5089b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:20:27.702773 14661 tablet_bootstrap.cc:654] T 6d19f88342f24607b835e3122c5089b9 P 8a08ef0f56be4ce495d0b4f432be9c3f: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:27.702879 14660 tablet_bootstrap.cc:492] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8: Bootstrap starting.
I20260618 23:20:27.703378 14661 log.cc:824] T 6d19f88342f24607b835e3122c5089b9 P 8a08ef0f56be4ce495d0b4f432be9c3f: Log is configured to *not* fsync() on all Append() calls
I20260618 23:20:27.703619 14660 tablet_bootstrap.cc:654] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:27.704170 14660 log.cc:824] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8: Log is configured to *not* fsync() on all Append() calls
I20260618 23:20:27.704327 14661 tablet_bootstrap.cc:492] T 6d19f88342f24607b835e3122c5089b9 P 8a08ef0f56be4ce495d0b4f432be9c3f: No bootstrap required, opened a new log
I20260618 23:20:27.704432 14661 ts_tablet_manager.cc:1397] T 6d19f88342f24607b835e3122c5089b9 P 8a08ef0f56be4ce495d0b4f432be9c3f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260618 23:20:27.705621 14664 tablet_bootstrap.cc:492] T 6d19f88342f24607b835e3122c5089b9 P 3c405958bcbf49548e9530cc3bebb23f: Bootstrap starting.
I20260618 23:20:27.706087 14660 tablet_bootstrap.cc:492] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8: No bootstrap required, opened a new log
I20260618 23:20:27.705968 14661 raft_consensus.cc:348] T 6d19f88342f24607b835e3122c5089b9 P 8a08ef0f56be4ce495d0b4f432be9c3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c405958bcbf49548e9530cc3bebb23f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 38243 } } peers { permanent_uuid: "e59264d320bb4e938b9dc951897913b8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41537 } } peers { permanent_uuid: "8a08ef0f56be4ce495d0b4f432be9c3f" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39115 } }
I20260618 23:20:27.706147 14661 raft_consensus.cc:374] T 6d19f88342f24607b835e3122c5089b9 P 8a08ef0f56be4ce495d0b4f432be9c3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:27.706171 14660 ts_tablet_manager.cc:1397] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260618 23:20:27.706192 14661 raft_consensus.cc:729] T 6d19f88342f24607b835e3122c5089b9 P 8a08ef0f56be4ce495d0b4f432be9c3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a08ef0f56be4ce495d0b4f432be9c3f, State: Initialized, Role: FOLLOWER
I20260618 23:20:27.706331 14664 tablet_bootstrap.cc:654] T 6d19f88342f24607b835e3122c5089b9 P 3c405958bcbf49548e9530cc3bebb23f: Neither blocks nor log segments found. Creating new log.
I20260618 23:20:27.706316 14661 consensus_queue.cc:260] T 6d19f88342f24607b835e3122c5089b9 P 8a08ef0f56be4ce495d0b4f432be9c3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c405958bcbf49548e9530cc3bebb23f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 38243 } } peers { permanent_uuid: "e59264d320bb4e938b9dc951897913b8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41537 } } peers { permanent_uuid: "8a08ef0f56be4ce495d0b4f432be9c3f" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39115 } }
I20260618 23:20:27.706647 14375 heartbeater.cc:503] Master 127.3.217.190:44437 was elected leader, sending a full tablet report...
I20260618 23:20:27.706650 14661 ts_tablet_manager.cc:1428] T 6d19f88342f24607b835e3122c5089b9 P 8a08ef0f56be4ce495d0b4f432be9c3f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:20:27.706926 14664 log.cc:824] T 6d19f88342f24607b835e3122c5089b9 P 3c405958bcbf49548e9530cc3bebb23f: Log is configured to *not* fsync() on all Append() calls
I20260618 23:20:27.707580 14664 tablet_bootstrap.cc:492] T 6d19f88342f24607b835e3122c5089b9 P 3c405958bcbf49548e9530cc3bebb23f: No bootstrap required, opened a new log
I20260618 23:20:27.707656 14664 ts_tablet_manager.cc:1397] T 6d19f88342f24607b835e3122c5089b9 P 3c405958bcbf49548e9530cc3bebb23f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260618 23:20:27.708115 14660 raft_consensus.cc:348] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c405958bcbf49548e9530cc3bebb23f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 38243 } } peers { permanent_uuid: "e59264d320bb4e938b9dc951897913b8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41537 } } peers { permanent_uuid: "8a08ef0f56be4ce495d0b4f432be9c3f" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39115 } }
I20260618 23:20:27.708250 14660 raft_consensus.cc:374] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:27.708348 14660 raft_consensus.cc:729] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e59264d320bb4e938b9dc951897913b8, State: Initialized, Role: FOLLOWER
I20260618 23:20:27.708515 14660 consensus_queue.cc:260] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c405958bcbf49548e9530cc3bebb23f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 38243 } } peers { permanent_uuid: "e59264d320bb4e938b9dc951897913b8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41537 } } peers { permanent_uuid: "8a08ef0f56be4ce495d0b4f432be9c3f" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39115 } }
I20260618 23:20:27.708796 14660 ts_tablet_manager.cc:1428] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260618 23:20:27.708820 14643 heartbeater.cc:503] Master 127.3.217.190:44437 was elected leader, sending a full tablet report...
I20260618 23:20:27.709394 14664 raft_consensus.cc:348] T 6d19f88342f24607b835e3122c5089b9 P 3c405958bcbf49548e9530cc3bebb23f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c405958bcbf49548e9530cc3bebb23f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 38243 } } peers { permanent_uuid: "e59264d320bb4e938b9dc951897913b8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41537 } } peers { permanent_uuid: "8a08ef0f56be4ce495d0b4f432be9c3f" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39115 } }
I20260618 23:20:27.709532 14664 raft_consensus.cc:374] T 6d19f88342f24607b835e3122c5089b9 P 3c405958bcbf49548e9530cc3bebb23f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:20:27.709568 14664 raft_consensus.cc:729] T 6d19f88342f24607b835e3122c5089b9 P 3c405958bcbf49548e9530cc3bebb23f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c405958bcbf49548e9530cc3bebb23f, State: Initialized, Role: FOLLOWER
I20260618 23:20:27.709694 14664 consensus_queue.cc:260] T 6d19f88342f24607b835e3122c5089b9 P 3c405958bcbf49548e9530cc3bebb23f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c405958bcbf49548e9530cc3bebb23f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 38243 } } peers { permanent_uuid: "e59264d320bb4e938b9dc951897913b8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41537 } } peers { permanent_uuid: "8a08ef0f56be4ce495d0b4f432be9c3f" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39115 } }
I20260618 23:20:27.709941 14664 ts_tablet_manager.cc:1428] T 6d19f88342f24607b835e3122c5089b9 P 3c405958bcbf49548e9530cc3bebb23f: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260618 23:20:27.710028 14509 heartbeater.cc:503] Master 127.3.217.190:44437 was elected leader, sending a full tablet report...
I20260618 23:20:27.720873 14667 raft_consensus.cc:482] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:20:27.720979 14667 raft_consensus.cc:504] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c405958bcbf49548e9530cc3bebb23f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 38243 } } peers { permanent_uuid: "e59264d320bb4e938b9dc951897913b8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41537 } } peers { permanent_uuid: "8a08ef0f56be4ce495d0b4f432be9c3f" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39115 } }
I20260618 23:20:27.721343 14667 leader_election.cc:288] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c405958bcbf49548e9530cc3bebb23f (127.3.217.130:38243), 8a08ef0f56be4ce495d0b4f432be9c3f (127.3.217.129:39115)
I20260618 23:20:27.724454 14669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:27.721532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:39115 (local address 127.3.217.131:51487)
0618 23:20:27.721720 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:27.721731 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:27.721787 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:27.721923 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:27.721924 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:27.721925 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:27.721987 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:27.721988 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.722634 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.722635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:27.723558 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:27.723561 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.724158 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.724159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:27.724242 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:27.724247 (+ 5us) client_negotiation.cc:769] Sending connection context
0618 23:20:27.724320 (+ 73us) client_negotiation.cc:240] Negotiation successful
0618 23:20:27.724372 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":98,"threads_started":1}
I20260618 23:20:27.724573 14659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:27.721644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:51487 (local address 127.3.217.129:39115)
0618 23:20:27.721691 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:27.721693 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:27.721799 (+ 106us) server_negotiation.cc:407] Connection header received
0618 23:20:27.721830 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:27.721832 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:27.721842 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:27.721899 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:27.722058 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.722510 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.723654 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.724060 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.724121 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:27.724128 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:27.724404 (+ 276us) server_negotiation.cc:299] Negotiation successful
0618 23:20:27.724474 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260618 23:20:27.724684 14645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:27.721472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:38243 (local address 127.3.217.131:35547)
0618 23:20:27.721533 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:27.721546 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:20:27.721592 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:20:27.721758 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:20:27.721759 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:20:27.721761 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:20:27.721856 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:27.721858 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.722703 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.722704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:27.723648 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:20:27.723651 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.724400 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.724400 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:20:27.724486 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:27.724490 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:20:27.724548 (+ 58us) client_negotiation.cc:240] Negotiation successful
0618 23:20:27.724601 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":47}
I20260618 23:20:27.724813 14658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:27.721587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:35547 (local address 127.3.217.130:38243)
0618 23:20:27.721630 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:27.721632 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:27.721641 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:20:27.721666 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:27.721667 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:27.721677 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:27.721742 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:20:27.721924 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.722595 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.723782 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.724243 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.724330 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:27.724337 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:27.724687 (+ 350us) server_negotiation.cc:299] Negotiation successful
0618 23:20:27.724730 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260618 23:20:27.725116 14329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d19f88342f24607b835e3122c5089b9" candidate_uuid: "e59264d320bb4e938b9dc951897913b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a08ef0f56be4ce495d0b4f432be9c3f" is_pre_election: true
I20260618 23:20:27.725248 14329 raft_consensus.cc:2454] T 6d19f88342f24607b835e3122c5089b9 P 8a08ef0f56be4ce495d0b4f432be9c3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e59264d320bb4e938b9dc951897913b8 in term 0.
I20260618 23:20:27.725267 14463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d19f88342f24607b835e3122c5089b9" candidate_uuid: "e59264d320bb4e938b9dc951897913b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c405958bcbf49548e9530cc3bebb23f" is_pre_election: true
I20260618 23:20:27.725463 14463 raft_consensus.cc:2454] T 6d19f88342f24607b835e3122c5089b9 P 3c405958bcbf49548e9530cc3bebb23f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e59264d320bb4e938b9dc951897913b8 in term 0.
I20260618 23:20:27.725490 14532 leader_election.cc:302] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a08ef0f56be4ce495d0b4f432be9c3f, e59264d320bb4e938b9dc951897913b8; no voters:
I20260618 23:20:27.725618 14667 raft_consensus.cc:2781] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:20:27.725674 14667 raft_consensus.cc:482] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:20:27.725695 14667 raft_consensus.cc:3037] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:27.726868 14667 raft_consensus.cc:504] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c405958bcbf49548e9530cc3bebb23f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 38243 } } peers { permanent_uuid: "e59264d320bb4e938b9dc951897913b8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41537 } } peers { permanent_uuid: "8a08ef0f56be4ce495d0b4f432be9c3f" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39115 } }
I20260618 23:20:27.727038 14667 leader_election.cc:288] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8 [CANDIDATE]: Term 1 election: Requested vote from peers 3c405958bcbf49548e9530cc3bebb23f (127.3.217.130:38243), 8a08ef0f56be4ce495d0b4f432be9c3f (127.3.217.129:39115)
I20260618 23:20:27.727208 14463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d19f88342f24607b835e3122c5089b9" candidate_uuid: "e59264d320bb4e938b9dc951897913b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c405958bcbf49548e9530cc3bebb23f"
I20260618 23:20:27.727284 14463 raft_consensus.cc:3037] T 6d19f88342f24607b835e3122c5089b9 P 3c405958bcbf49548e9530cc3bebb23f [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:27.727247 14329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d19f88342f24607b835e3122c5089b9" candidate_uuid: "e59264d320bb4e938b9dc951897913b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a08ef0f56be4ce495d0b4f432be9c3f"
I20260618 23:20:27.727358 14329 raft_consensus.cc:3037] T 6d19f88342f24607b835e3122c5089b9 P 8a08ef0f56be4ce495d0b4f432be9c3f [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:20:27.728120 14329 raft_consensus.cc:2454] T 6d19f88342f24607b835e3122c5089b9 P 8a08ef0f56be4ce495d0b4f432be9c3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e59264d320bb4e938b9dc951897913b8 in term 1.
I20260618 23:20:27.728492 14532 leader_election.cc:302] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a08ef0f56be4ce495d0b4f432be9c3f, e59264d320bb4e938b9dc951897913b8; no voters:
I20260618 23:20:27.728629 14667 raft_consensus.cc:2781] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:20:27.728781 14463 raft_consensus.cc:2454] T 6d19f88342f24607b835e3122c5089b9 P 3c405958bcbf49548e9530cc3bebb23f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e59264d320bb4e938b9dc951897913b8 in term 1.
I20260618 23:20:27.728902 14667 raft_consensus.cc:686] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8 [term 1 LEADER]: Becoming Leader. State: Replica: e59264d320bb4e938b9dc951897913b8, State: Running, Role: LEADER
I20260618 23:20:27.729041 14667 consensus_queue.cc:237] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c405958bcbf49548e9530cc3bebb23f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 38243 } } peers { permanent_uuid: "e59264d320bb4e938b9dc951897913b8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41537 } } peers { permanent_uuid: "8a08ef0f56be4ce495d0b4f432be9c3f" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39115 } }
I20260618 23:20:27.730017 14184 catalog_manager.cc:5495] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e59264d320bb4e938b9dc951897913b8 (127.3.217.131). New cstate: current_term: 1 leader_uuid: "e59264d320bb4e938b9dc951897913b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c405958bcbf49548e9530cc3bebb23f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 38243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e59264d320bb4e938b9dc951897913b8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a08ef0f56be4ce495d0b4f432be9c3f" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39115 } health_report { overall_health: UNKNOWN } } }
I20260618 23:20:27.745839 14657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:27.742361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50596 (local address 127.3.217.131:41537)
0618 23:20:27.742470 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0618 23:20:27.742472 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:20:27.742481 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:20:27.742519 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:20:27.742520 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:20:27.742541 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:20:27.742621 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:20:27.743476 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.743979 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.744813 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:20:27.745025 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:20:27.745100 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:20:27.745364 (+ 264us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:20:27.745500 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:20:27.745587 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0618 23:20:27.745671 (+ 84us) server_negotiation.cc:299] Negotiation successful
0618 23:20:27.745694 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260618 23:20:27.746219 14510 tablet.cc:2369] T 6d19f88342f24607b835e3122c5089b9 P 3c405958bcbf49548e9530cc3bebb23f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 23:20:27.749225 14463 raft_consensus.cc:1261] T 6d19f88342f24607b835e3122c5089b9 P 3c405958bcbf49548e9530cc3bebb23f [term 1 FOLLOWER]: Refusing update from remote peer e59264d320bb4e938b9dc951897913b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:20:27.749373 14329 raft_consensus.cc:1261] T 6d19f88342f24607b835e3122c5089b9 P 8a08ef0f56be4ce495d0b4f432be9c3f [term 1 FOLLOWER]: Refusing update from remote peer e59264d320bb4e938b9dc951897913b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:20:27.749783 14667 consensus_queue.cc:1035] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c405958bcbf49548e9530cc3bebb23f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 38243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:20:27.750016 14670 consensus_queue.cc:1035] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a08ef0f56be4ce495d0b4f432be9c3f" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 39115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:20:27.753048 14673 mvcc.cc:205] Tried to move back new op lower bound from 7298354494455672832 to 7298354494379110400. Current Snapshot: MvccSnapshot[applied={T|T < 7298354494455672832}]
I20260618 23:20:27.755261 14183 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48200:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:20:27.755440 14183 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48200:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:20:27.757025 14183 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 37a6f277840d40c98e5fbbaa9275801a: Sending DeleteTablet for 3 replicas of tablet 6d19f88342f24607b835e3122c5089b9
I20260618 23:20:27.757462 14577 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d19f88342f24607b835e3122c5089b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:20:27 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:50588
I20260618 23:20:27.757462 14443 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d19f88342f24607b835e3122c5089b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:20:27 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:50922
I20260618 23:20:27.757627 14309 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d19f88342f24607b835e3122c5089b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:20:27 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:48178
I20260618 23:20:27.757786 14682 tablet_replica.cc:330] T 6d19f88342f24607b835e3122c5089b9 P 3c405958bcbf49548e9530cc3bebb23f: stopping tablet replica
I20260618 23:20:27.757953 14682 raft_consensus.cc:2229] T 6d19f88342f24607b835e3122c5089b9 P 3c405958bcbf49548e9530cc3bebb23f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:20:27.758105 14682 raft_consensus.cc:2258] T 6d19f88342f24607b835e3122c5089b9 P 3c405958bcbf49548e9530cc3bebb23f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:20:27.758345 14683 tablet_replica.cc:330] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8: stopping tablet replica
I20260618 23:20:27.758391 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 14246
I20260618 23:20:27.758468 14683 raft_consensus.cc:2229] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8 [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:20:27.758606 14683 raft_consensus.cc:2258] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:20:27.759318 14683 ts_tablet_manager.cc:1905] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:20:27.759485 14682 ts_tablet_manager.cc:1905] T 6d19f88342f24607b835e3122c5089b9 P 3c405958bcbf49548e9530cc3bebb23f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:20:27.762576 14683 ts_tablet_manager.cc:1918] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:20:27.762600 14682 ts_tablet_manager.cc:1918] T 6d19f88342f24607b835e3122c5089b9 P 3c405958bcbf49548e9530cc3bebb23f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:20:27.762691 14683 log.cc:1196] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/6d19f88342f24607b835e3122c5089b9
I20260618 23:20:27.762897 14682 log.cc:1196] T 6d19f88342f24607b835e3122c5089b9 P 3c405958bcbf49548e9530cc3bebb23f: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/6d19f88342f24607b835e3122c5089b9
I20260618 23:20:27.763015 14683 ts_tablet_manager.cc:1939] T 6d19f88342f24607b835e3122c5089b9 P e59264d320bb4e938b9dc951897913b8: Deleting consensus metadata
I20260618 23:20:27.763316 14682 ts_tablet_manager.cc:1939] T 6d19f88342f24607b835e3122c5089b9 P 3c405958bcbf49548e9530cc3bebb23f: Deleting consensus metadata
I20260618 23:20:27.763828 14169 catalog_manager.cc:4841] TS 3c405958bcbf49548e9530cc3bebb23f (127.3.217.130:38243): tablet 6d19f88342f24607b835e3122c5089b9 (table test-table [id=5bd04c75cd4a46d0a0242674c9e7e73a]) successfully deleted
I20260618 23:20:27.763969 14168 catalog_manager.cc:4841] TS e59264d320bb4e938b9dc951897913b8 (127.3.217.131:41537): tablet 6d19f88342f24607b835e3122c5089b9 (table test-table [id=5bd04c75cd4a46d0a0242674c9e7e73a]) successfully deleted
W20260618 23:20:27.767475 14170 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.217.129:39115 (error 108)
I20260618 23:20:27.768122 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 14380
I20260618 23:20:27.768148 14656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:20:27.767990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:39115 (local address 127.0.0.1:48192)
0618 23:20:27.768064 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0618 23:20:27.768108 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.129:39115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260618 23:20:27.769644 14170 catalog_manager.cc:4584] TS 8a08ef0f56be4ce495d0b4f432be9c3f (127.3.217.129:39115): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6d19f88342f24607b835e3122c5089b9: Network error: Client connection negotiation failed: client connection to 127.3.217.129:39115: connect: Connection refused (error 111)
I20260618 23:20:27.774834 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 14514
I20260618 23:20:27.780632 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 14152
2026-06-18T23:20:27Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2039 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:20:27 dist-test-slave-r9ct krb5kdc[14688](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:20:27 dist-test-slave-r9ct krb5kdc[14688](info): set up 2 sockets
Jun 18 23:20:27 dist-test-slave-r9ct krb5kdc[14688](info): commencing operation
krb5kdc: starting...
W20260618 23:20:28.844267 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:20:28 dist-test-slave-r9ct krb5kdc[14688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824828, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:20:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:20:28Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.3.217.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.3.217.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.3.217.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/rangeradmin_127.3.217.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.3.217.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/rangeradmin_127.3.217.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.3.217.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.3.217.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.3.217.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/rangerlookup_127.3.217.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.3.217.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/rangerlookup_127.3.217.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.3.217.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.3.217.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.3.217.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/HTTP_127.3.217.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.3.217.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/HTTP_127.3.217.148@KRBTEST.COM.keytab.
I20260618 23:20:29.019119 3942 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskY_cj0P/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/postgres -l logfile start
2026-06-18 23:20:32.067 UTC [14718] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-06-18 23:20:32.067 UTC [14718] LOG: listening on IPv4 address "127.3.217.148", port 57093
2026-06-18 23:20:32.071 UTC [14718] LOG: listening on Unix socket "/tmp/.s.PGSQL.57093"
2026-06-18 23:20:32.099 UTC [14721] LOG: database system was shut down at 2026-06-18 23:20:30 UTC
2026-06-18 23:20:32.104 UTC [14718] LOG: database system is ready to accept connections
I20260618 23:20:33.093163 3942 mini_postgres.cc:96] Postgres bound to 57093
2026-06-18 23:20:33.100 UTC [14729] FATAL: database "slave" does not exist
127.3.217.148:57093 - accepting connections
I20260618 23:20:33.101249 3942 mini_ranger.cc:161] Starting Ranger...
I20260618 23:20:33.117698 3942 mini_ranger.cc:84] Created miniranger Postgres user
I20260618 23:20:33.807585 3942 mini_ranger.cc:87] Created ranger Postgres database
I20260618 23:20:33.807669 3942 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ranger-admin
2026-06-18 23:20:34,163 [I] DB FLAVOR :POSTGRES
2026-06-18 23:20:34,164 [I] --------- Verifying Ranger DB connection ---------
2026-06-18 23:20:34,164 [I] Checking connection..
2026-06-18 23:20:34,164 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-06-18 23:20:34,452 [I] Checking connection passed.
2026-06-18 23:20:34,453 [I] --------- Verifying version history table ---------
2026-06-18 23:20:34,453 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-18 23:20:34,715 [I] Table x_db_version_h does not exist in database ranger
2026-06-18 23:20:34,715 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-18 23:20:34,971 [I] Table x_db_version_h does not exist in database ranger
2026-06-18 23:20:34,972 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-06-18 23:20:34,972 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-06-18 23:20:35.217 UTC [14793] WARNING: there is no transaction in progress
2026-06-18 23:20:35,224 [I] create_dbversion_catalog.sql file imported successfully
2026-06-18 23:20:35,224 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-18 23:20:35,506 [I] Table x_db_version_h already exists in database 'ranger'
2026-06-18 23:20:35,507 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-18 23:20:35,507 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-06-18 23:20:35,767 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-06-18 23:20:36,018 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-r9ct.c.gcp-upstream.internal','N') ;"
2026-06-18 23:20:36,276 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-18 23:20:36,527 [I] Table x_portal_user does not exist in database ranger
2026-06-18 23:20:36,528 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-18 23:20:36,796 [I] Table x_policy_ref_group does not exist in database ranger
2026-06-18 23:20:36,796 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-18 23:20:37,051 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-18 23:20:37,323 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-06-18 23:20:37,323 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-06-18 23:20:38.453 UTC [14901] WARNING: there is no transaction in progress
2026-06-18 23:20:38.473 UTC [14901] WARNING: there is no transaction in progress
2026-06-18 23:20:38.493 UTC [14901] WARNING: there is no transaction in progress
2026-06-18 23:20:38.512 UTC [14901] WARNING: there is no transaction in progress
2026-06-18 23:20:38.533 UTC [14901] WARNING: there is no transaction in progress
2026-06-18 23:20:38.558 UTC [14901] WARNING: there is no transaction in progress
2026-06-18 23:20:38.635 UTC [14901] WARNING: there is no transaction in progress
2026-06-18 23:20:38.644 UTC [14901] WARNING: there is no transaction in progress
2026-06-18 23:20:38.663 UTC [14901] WARNING: there is no transaction in progress
2026-06-18 23:20:38.676 UTC [14901] WARNING: there is no transaction in progress
2026-06-18 23:20:38.689 UTC [14901] WARNING: there is no transaction in progress
2026-06-18 23:20:38.705 UTC [14901] WARNING: there is no transaction in progress
2026-06-18 23:20:38.718 UTC [14901] WARNING: there is no transaction in progress
2026-06-18 23:20:38.726 UTC [14901] WARNING: there is no transaction in progress
2026-06-18 23:20:38.734 UTC [14901] WARNING: there is no transaction in progress
2026-06-18 23:20:38.741 UTC [14901] WARNING: there is no transaction in progress
2026-06-18 23:20:39,572 [I] ranger_core_db_postgres.sql file imported successfully
2026-06-18 23:20:39,573 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-06-18 23:20:39,814 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-06-18 23:20:39,814 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-18 23:20:40,090 [I] Table x_portal_user already exists in database 'ranger'
2026-06-18 23:20:40,090 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-18 23:20:40,361 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-06-18 23:20:40,362 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-18 23:20:40,618 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-18 23:20:40,853 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-r9ct.c.gcp-upstream.internal';"
2026-06-18 23:20:41,108 [I] CORE_DB_SCHEMA import status has been updated
2026-06-18 23:20:41,108 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-06-18 23:20:41,352 [I] DB_PATCHES have already been applied
I20260618 23:20:41.358353 3942 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ranger-admin:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskY_cj0P/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260618 23:20:41.358421 3942 mini_ranger.cc:193] Using host: 127.3.217.148
I20260618 23:20:41.361511 3942 mini_ranger.cc:227] Ranger admin URL: http://127.3.217.148:40217
Jun 18, 2026 11:20:41 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 18, 2026 11:20:41 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 18, 2026 11:20:41 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ranger-admin/ews/webapp
Jun 18, 2026 11:20:41 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Jun 18, 2026 11:20:41 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ranger-admin/ews/webapp] .....
Jun 18, 2026 11:20:42 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ranger-admin/ews/webapp].
Jun 18, 2026 11:20:42 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260618 23:20:42.482899 3942 mini_ranger.cc:160] Time spent starting Ranger: real 9.382s user 0.000s sys 0.010s
Jun 18, 2026 11:21:03 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Jun 18, 2026 11:21:03 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.XKeyREST
Jun 18, 2026 11:21:03 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Jun 18, 2026 11:21:03 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Jun 18, 2026 11:21:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Jun 18, 2026 11:21:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Jun 18, 2026 11:21:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Jun 18, 2026 11:21:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Jun 18, 2026 11:21:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Jun 18, 2026 11:21:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Jun 18, 2026 11:21:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Jun 18, 2026 11:21:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Jun 18, 2026 11:21:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Jun 18, 2026 11:21:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Jun 18, 2026 11:21:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Jun 18, 2026 11:21:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Jun 18, 2026 11:21:03 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Jun 18, 2026 11:21:04 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260618 23:21:05.332404 3942 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.3.217.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.3.217.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.3.217.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/rangerkms_127.3.217.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.3.217.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/rangerkms_127.3.217.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.3.217.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.3.217.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.3.217.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/HTTP_127.3.217.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.3.217.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/HTTP_127.3.217.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Jun 18 23:21:05 dist-test-slave-r9ct krb5kdc[14688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824865, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260618 23:21:05.435932 3942 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260618 23:21:05.445899 3942 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260618 23:21:06.633828 3942 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260618 23:21:06.633925 3942 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ranger-kms
I20260618 23:21:06.633949 3942 mini_ranger_kms.cc:227] Using postgres at 127.3.217.148:57093
2026-06-18 23:21:06,850 [I] DB FLAVOR :POSTGRES
2026-06-18 23:21:06,850 [I] --------- Verifying Ranger DB connection ---------
2026-06-18 23:21:06,850 [I] Checking connection
2026-06-18 23:21:06,850 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-06-18 23:21:07,132 [I] connection success
2026-06-18 23:21:07,133 [I] --------- Verifying Ranger DB tables ---------
2026-06-18 23:21:07,133 [I] Verifying table ranger_masterkey in database rangerkms
2026-06-18 23:21:07,133 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-06-18 23:21:07,387 [I] Table ranger_masterkey does not exist in database rangerkms
2026-06-18 23:21:07,387 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-18 23:21:07,387 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-06-18 23:21:07,387 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:57093/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-06-18 23:21:07,684 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260618 23:21:08.266340 3942 mini_ranger_kms.cc:310] Created kms service
I20260618 23:21:08.437253 3942 mini_ranger_kms.cc:326] Created kudu user
I20260618 23:21:08.502578 3942 mini_ranger_kms.cc:343] Created rangerkms user
Jun 18 23:21:08 dist-test-slave-r9ct krb5kdc[14688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824865, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.3.217.148@KRBTEST.COM
I20260618 23:21:08.951234 3942 mini_ranger_kms.cc:384] Added ranger policy
I20260618 23:21:08.951344 3942 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ranger-kms:/tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260618 23:21:08.951364 3942 mini_ranger_kms.cc:240] Using host: 127.3.217.148
I20260618 23:21:08.955075 3942 mini_ranger_kms.cc:276] Ranger KMS PID: 15082
I20260618 23:21:08.955192 3942 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.3.217.148:39641
Jun 18, 2026 11:21:10 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 18, 2026 11:21:10 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 18, 2026 11:21:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Jun 18, 2026 11:21:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ranger-kms/ews/webapp] .....
Jun 18, 2026 11:21:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ranger-kms/ews/webapp].
Jun 18, 2026 11:21:10 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260618 23:21:11.379251 3942 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.943s user 0.002s sys 0.193s
I20260618 23:21:11.379387 3942 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260618 23:21:11.379611 3942 mini_ranger_kms.cc:401] 127.3.217.148:39641/kms/v1/keys
Jun 18 23:21:11 dist-test-slave-r9ct krb5kdc[14688](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781824871, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.3.217.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Jun 18 23:21:12 dist-test-slave-r9ct krb5kdc[14688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824871, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.3.217.148@KRBTEST.COM for HTTP/127.3.217.148@KRBTEST.COM
Jun 18 23:21:12 dist-test-slave-r9ct krb5kdc[14688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824871, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.3.217.148@KRBTEST.COM for HTTP/127.3.217.148@KRBTEST.COM
Jun 18 23:21:14 dist-test-slave-r9ct krb5kdc[14688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:21:15.026631 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:32831
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:41937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:32831
--ranger_config_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.217.148:39641/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:21:15.119458 15132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:21:15.119652 15132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:21:15.119673 15132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:21:15.120782 15132 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:21:15.120821 15132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:21:15.120836 15132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:21:15.120847 15132 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:21:15.120859 15132 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:21:15.122417 15132 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:41937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/master-0/wal
--ranger_kms_url=127.3.217.148:39641/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:32831
--ranger_config_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:32831
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:21:15.122874 15132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:21:15.123214 15132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260618 23:21:15.130650 15132 server_base.cc:1034] running on GCE node
W20260618 23:21:15.130756 15138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:21:15.130638 15140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:21:15.130825 15137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:21:15.131243 15132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:21:15.131573 15132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:21:15.132825 15132 hybrid_clock.cc:648] HybridClock initialized: now 1781824875132796 us; error 36 us; skew 500 ppm
Jun 18 23:21:15 dist-test-slave-r9ct krb5kdc[14688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824875, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:21:15.141119 15132 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:21:15.141793 15132 webserver.cc:460] Webserver started at http://127.3.217.190:38423/ using document root <none> and password file <none>
I20260618 23:21:15.142061 15132 fs_manager.cc:359] Metadata directory not provided
I20260618 23:21:15.142122 15132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:21:15.142542 15132 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 18 23:21:15 dist-test-slave-r9ct krb5kdc[14688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824875, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for HTTP/127.3.217.148@KRBTEST.COM
I20260618 23:21:15.193200 15132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "9e50512407c9452eb71edd819f819583"
format_stamp: "Formatted at 2026-06-18 23:21:15 on dist-test-slave-r9ct"
server_key: "e48cf081065836e590e780257001e54d"
server_key_iv: "8d2032bd52550d7f6629655b1bc9e3ae"
server_key_version: "kuduclusterkey@0"
I20260618 23:21:15.193588 15132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "9e50512407c9452eb71edd819f819583"
format_stamp: "Formatted at 2026-06-18 23:21:15 on dist-test-slave-r9ct"
server_key: "e48cf081065836e590e780257001e54d"
server_key_iv: "8d2032bd52550d7f6629655b1bc9e3ae"
server_key_version: "kuduclusterkey@0"
I20260618 23:21:15.195016 15132 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260618 23:21:15.208555 15147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:21:15.208781 15132 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:21:15.208880 15132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "9e50512407c9452eb71edd819f819583"
format_stamp: "Formatted at 2026-06-18 23:21:15 on dist-test-slave-r9ct"
server_key: "e48cf081065836e590e780257001e54d"
server_key_iv: "8d2032bd52550d7f6629655b1bc9e3ae"
server_key_version: "kuduclusterkey@0"
I20260618 23:21:15.208988 15132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:21:15.228478 15132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:21:15.231611 15132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:21:15.231823 15132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:21:15.237174 15132 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:32831
I20260618 23:21:15.237203 15199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:32831 every 8 connection(s)
I20260618 23:21:15.237644 15132 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:21:15.238327 15200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:21:15.241132 15200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583: Bootstrap starting.
I20260618 23:21:15.241782 15200 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583: Neither blocks nor log segments found. Creating new log.
I20260618 23:21:15.242120 15200 log.cc:824] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583: Log is configured to *not* fsync() on all Append() calls
I20260618 23:21:15.243360 15200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583: No bootstrap required, opened a new log
I20260618 23:21:15.243448 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 15132
I20260618 23:21:15.243583 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:21:15.243774 3942 external_mini_cluster.cc:1428] Setting key cea6daab2c721ccfbacdaa0f5a2bcf67
I20260618 23:21:15.246549 15200 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e50512407c9452eb71edd819f819583" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 32831 } }
I20260618 23:21:15.246788 15200 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:21:15.246861 15200 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e50512407c9452eb71edd819f819583, State: Initialized, Role: FOLLOWER
I20260618 23:21:15.247035 15200 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e50512407c9452eb71edd819f819583" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 32831 } }
I20260618 23:21:15.247169 15200 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:21:15.247233 15200 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:21:15.247291 15200 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:21:15.247984 15200 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e50512407c9452eb71edd819f819583" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 32831 } }
I20260618 23:21:15.248108 15200 leader_election.cc:302] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9e50512407c9452eb71edd819f819583; no voters:
I20260618 23:21:15.248314 15200 leader_election.cc:288] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:21:15.248351 15205 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:21:15.248752 15205 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583 [term 1 LEADER]: Becoming Leader. State: Replica: 9e50512407c9452eb71edd819f819583, State: Running, Role: LEADER
I20260618 23:21:15.248878 15200 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:21:15.248940 15205 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e50512407c9452eb71edd819f819583" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 32831 } }
I20260618 23:21:15.249424 15205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9e50512407c9452eb71edd819f819583" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e50512407c9452eb71edd819f819583" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 32831 } } }
I20260618 23:21:15.249538 15205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583 [sys.catalog]: This master's current role is: LEADER
I20260618 23:21:15.249727 15205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e50512407c9452eb71edd819f819583. Latest consensus state: current_term: 1 leader_uuid: "9e50512407c9452eb71edd819f819583" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e50512407c9452eb71edd819f819583" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 32831 } } }
I20260618 23:21:15.249826 15205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583 [sys.catalog]: This master's current role is: LEADER
I20260618 23:21:15.250751 15200 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260618 23:21:15.251187 15211 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:21:15.251714 15211 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Jun 18 23:21:15 dist-test-slave-r9ct krb5kdc[14688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:21:15.258065 15211 catalog_manager.cc:1347] Generated new cluster ID: fcb73014c3bd4144bd413756128ad14a
I20260618 23:21:15.258160 15211 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:21:15.261232 15204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:21:15.244601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43260 (local address 127.3.217.190:32831)
0618 23:21:15.244982 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0618 23:21:15.244993 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0618 23:21:15.245049 (+ 56us) server_negotiation.cc:407] Connection header received
0618 23:21:15.246615 (+ 1566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:21:15.246627 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:21:15.246748 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:21:15.247962 (+ 1214us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:21:15.248087 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:21:15.249792 (+ 1705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:21:15.251006 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:21:15.251641 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:21:15.252465 (+ 824us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:21:15.255654 (+ 3189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:21:15.255674 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:21:15.255674 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:21:15.255714 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:21:15.259115 (+ 3401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:21:15.259697 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:21:15.259701 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:21:15.259702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:21:15.259823 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:21:15.260017 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:21:15.260018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:21:15.260018 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:21:15.260322 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:21:15.260459 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0618 23:21:15.260580 (+ 121us) server_negotiation.cc:299] Negotiation successful
0618 23:21:15.260881 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":102,"threads_started":1}
I20260618 23:21:15.287796 15211 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:21:15.288667 15211 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:21:15.295451 15211 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583: Generated new TSK 0
I20260618 23:21:15.295717 15211 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.217.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
I20260618 23:21:16.103441 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.217.148:39641/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:32831
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:41937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:21:16.227487 15245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:21:16.227689 15245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:21:16.227715 15245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:21:16.228868 15245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:21:16.228929 15245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:21:16.228972 15245 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:21:16.230399 15245 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:41937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.3.217.148:39641/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:32831
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15245
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:21:16.230656 15245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:21:16.230906 15245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:21:16.236042 15253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:21:16.236328 15250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:21:16.236359 15245 server_base.cc:1034] running on GCE node
W20260618 23:21:16.236042 15251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:21:16.236685 15245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:21:16.236955 15245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:21:16.238128 15245 hybrid_clock.cc:648] HybridClock initialized: now 1781824876238106 us; error 35 us; skew 500 ppm
Jun 18 23:21:16 dist-test-slave-r9ct krb5kdc[14688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824876, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:21:16.240820 15245 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:21:16.241319 15245 webserver.cc:460] Webserver started at http://127.3.217.129:35939/ using document root <none> and password file <none>
I20260618 23:21:16.241550 15245 fs_manager.cc:359] Metadata directory not provided
I20260618 23:21:16.241598 15245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:21:16.241716 15245 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 18 23:21:16 dist-test-slave-r9ct krb5kdc[14688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824876, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for HTTP/127.3.217.148@KRBTEST.COM
I20260618 23:21:16.256832 15245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "86b6035d4ae6496a909367b57addd682"
format_stamp: "Formatted at 2026-06-18 23:21:16 on dist-test-slave-r9ct"
server_key: "0fd7f64d9e74ee38403224b3fe829839"
server_key_iv: "9a5f4b7e607e6c4825d962be53a3fed7"
server_key_version: "kuduclusterkey@0"
I20260618 23:21:16.257418 15245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "86b6035d4ae6496a909367b57addd682"
format_stamp: "Formatted at 2026-06-18 23:21:16 on dist-test-slave-r9ct"
server_key: "0fd7f64d9e74ee38403224b3fe829839"
server_key_iv: "9a5f4b7e607e6c4825d962be53a3fed7"
server_key_version: "kuduclusterkey@0"
I20260618 23:21:16.260378 15245 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260618 23:21:16.277302 15262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:21:16.285300 15245 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.001s sys 0.000s
I20260618 23:21:16.285496 15245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "86b6035d4ae6496a909367b57addd682"
format_stamp: "Formatted at 2026-06-18 23:21:16 on dist-test-slave-r9ct"
server_key: "0fd7f64d9e74ee38403224b3fe829839"
server_key_iv: "9a5f4b7e607e6c4825d962be53a3fed7"
server_key_version: "kuduclusterkey@0"
I20260618 23:21:16.285687 15245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:21:16.325477 15245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:21:16.328083 15245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:21:16.328363 15245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:21:16.328634 15245 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:21:16.329025 15245 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:21:16.329097 15245 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:21:16.329186 15245 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:21:16.329252 15245 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:21:16.337420 15245 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:45317
I20260618 23:21:16.337920 15245 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:21:16.340344 15375 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:45317 every 8 connection(s)
I20260618 23:21:16.346619 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 15245
I20260618 23:21:16.346753 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:21:16.346949 3942 external_mini_cluster.cc:1428] Setting key 25fddc67b45ec4126a180e99d4a8b213
Jun 18 23:21:16 dist-test-slave-r9ct krb5kdc[14688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824876, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:21:16.355501 15378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:21:16.340342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:32831 (local address 127.3.217.129:55361)
0618 23:21:16.340822 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0618 23:21:16.340867 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0618 23:21:16.341457 (+ 590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:21:16.343462 (+ 2005us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:21:16.343467 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:21:16.343713 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:21:16.344028 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:21:16.344034 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.345090 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.345091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:21:16.346388 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:21:16.346391 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.347614 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.347615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:21:16.347753 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:21:16.349983 (+ 2230us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:21:16.349994 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:21:16.351699 (+ 1705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:21:16.353864 (+ 2165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:21:16.353871 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:21:16.353873 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:21:16.354196 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:21:16.354421 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:21:16.354421 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:21:16.354422 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:21:16.354552 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:21:16.354852 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:21:16.354858 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:21:16.355016 (+ 158us) client_negotiation.cc:769] Sending connection context
0618 23:21:16.355113 (+ 97us) client_negotiation.cc:240] Negotiation successful
0618 23:21:16.355263 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":152,"threads_started":1}
I20260618 23:21:16.356153 15379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:21:16.340692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:55361 (local address 127.3.217.190:32831)
0618 23:21:16.343178 (+ 2486us) server_negotiation.cc:206] Beginning negotiation
0618 23:21:16.343181 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:21:16.343191 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:21:16.343255 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:21:16.343256 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:21:16.343270 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:21:16.344165 (+ 895us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:21:16.344208 (+ 43us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.344983 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.347236 (+ 2253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.347516 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.351821 (+ 4305us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:21:16.351886 (+ 65us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:21:16.351886 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:21:16.351887 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:21:16.351893 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:21:16.353764 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:21:16.354293 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:21:16.354294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:21:16.354295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:21:16.354354 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:21:16.354624 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:21:16.354625 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:21:16.354625 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:21:16.354778 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:21:16.355929 (+ 1151us) server_negotiation.cc:1035] Waiting for connection context
0618 23:21:16.355970 (+ 41us) server_negotiation.cc:299] Negotiation successful
0618 23:21:16.356049 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2463,"thread_start_us":56,"threads_started":1}
I20260618 23:21:16.356705 15376 heartbeater.cc:347] Connected to a master server at 127.3.217.190:32831
I20260618 23:21:16.356802 15376 heartbeater.cc:464] Registering TS with master...
I20260618 23:21:16.356985 15376 heartbeater.cc:511] Master 127.3.217.190:32831 requested a full tablet report, sending...
I20260618 23:21:16.357653 15164 ts_manager.cc:194] Registered new tserver with Master: 86b6035d4ae6496a909367b57addd682 (127.3.217.129:45317)
I20260618 23:21:16.358460 15164 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:55361
WARNING: no policy specified for kudu/127.3.217.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
I20260618 23:21:16.405822 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.217.148:39641/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:32831
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:41937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 18 23:21:16 dist-test-slave-r9ct krb5kdc[14688](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781824876, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260618 23:21:16.535238 15384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:21:16.535615 15384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:21:16.535712 15384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:21:16.537536 15384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:21:16.537789 15384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:21:16.537897 15384 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:21:16.540583 15384 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:41937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.3.217.148:39641/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:32831
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:21:16.541079 15384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:21:16.541430 15384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:21:16.548247 15392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:21:16.548352 15390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:21:16.548707 15389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:21:16.550441 15384 server_base.cc:1034] running on GCE node
I20260618 23:21:16.550930 15384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:21:16.551272 15384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:21:16.552419 15384 hybrid_clock.cc:648] HybridClock initialized: now 1781824876552398 us; error 37 us; skew 500 ppm
Jun 18 23:21:16 dist-test-slave-r9ct krb5kdc[14688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824876, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:21:16.555552 15384 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:21:16.556107 15384 webserver.cc:460] Webserver started at http://127.3.217.130:41455/ using document root <none> and password file <none>
I20260618 23:21:16.556409 15384 fs_manager.cc:359] Metadata directory not provided
I20260618 23:21:16.556504 15384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:21:16.556666 15384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 18 23:21:16 dist-test-slave-r9ct krb5kdc[14688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824876, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for HTTP/127.3.217.148@KRBTEST.COM
I20260618 23:21:16.571864 15384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "389708a885cc4c34ae635f9b6d118a45"
format_stamp: "Formatted at 2026-06-18 23:21:16 on dist-test-slave-r9ct"
server_key: "729ba6e8d084f5c9d0247d8894a948e5"
server_key_iv: "6f9aa85e2b03c9ddf4c6c5ac20b16a60"
server_key_version: "kuduclusterkey@0"
I20260618 23:21:16.572340 15384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "389708a885cc4c34ae635f9b6d118a45"
format_stamp: "Formatted at 2026-06-18 23:21:16 on dist-test-slave-r9ct"
server_key: "729ba6e8d084f5c9d0247d8894a948e5"
server_key_iv: "6f9aa85e2b03c9ddf4c6c5ac20b16a60"
server_key_version: "kuduclusterkey@0"
I20260618 23:21:16.574026 15384 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260618 23:21:16.586886 15400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:21:16.587095 15384 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:21:16.587215 15384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "389708a885cc4c34ae635f9b6d118a45"
format_stamp: "Formatted at 2026-06-18 23:21:16 on dist-test-slave-r9ct"
server_key: "729ba6e8d084f5c9d0247d8894a948e5"
server_key_iv: "6f9aa85e2b03c9ddf4c6c5ac20b16a60"
server_key_version: "kuduclusterkey@0"
I20260618 23:21:16.587332 15384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:21:16.617620 15384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:21:16.620754 15384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:21:16.620898 15384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:21:16.621097 15384 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:21:16.621454 15384 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:21:16.621511 15384 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:21:16.621541 15384 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:21:16.621573 15384 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:21:16.629189 15384 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:45469
I20260618 23:21:16.629616 15384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:21:16.630481 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 15384
I20260618 23:21:16.630625 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:21:16.630957 3942 external_mini_cluster.cc:1428] Setting key 58b18cc2faaedfe3fa0e57a2be8362cf
I20260618 23:21:16.641045 15513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:45469 every 8 connection(s)
WARNING: no policy specified for kudu/127.3.217.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.131@KRBTEST.COM" created.
Jun 18 23:21:16 dist-test-slave-r9ct krb5kdc[14688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824876, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:21:16.650913 15379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:21:16.631326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:55773 (local address 127.3.217.190:32831)
0618 23:21:16.631374 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0618 23:21:16.631376 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:21:16.639365 (+ 7989us) server_negotiation.cc:407] Connection header received
0618 23:21:16.640074 (+ 709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:21:16.640076 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:21:16.640091 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:21:16.640123 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:21:16.641191 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.641972 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.643583 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.643942 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.643987 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:21:16.647230 (+ 3243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:21:16.647232 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:21:16.647232 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:21:16.647240 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:21:16.649065 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:21:16.649641 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:21:16.649642 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:21:16.649643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:21:16.649726 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:21:16.650049 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:21:16.650051 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:21:16.650051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:21:16.650205 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:21:16.650263 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0618 23:21:16.650671 (+ 408us) server_negotiation.cc:299] Negotiation successful
0618 23:21:16.650794 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260618 23:21:16.651393 15516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:21:16.630570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:32831 (local address 127.3.217.130:55773)
0618 23:21:16.639195 (+ 8625us) negotiation.cc:107] Waiting for socket to connect
0618 23:21:16.639257 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0618 23:21:16.639949 (+ 692us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:21:16.640311 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:21:16.640316 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:21:16.640563 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:21:16.640855 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:21:16.640860 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.642084 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.642084 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:21:16.643350 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:21:16.643353 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.644080 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.644080 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:21:16.644515 (+ 435us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:21:16.645251 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:21:16.645262 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:21:16.647107 (+ 1845us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:21:16.649168 (+ 2061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:21:16.649175 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:21:16.649178 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:21:16.649562 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:21:16.649801 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:21:16.649802 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:21:16.649802 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:21:16.649941 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:21:16.650300 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:21:16.650306 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:21:16.650479 (+ 173us) client_negotiation.cc:769] Sending connection context
0618 23:21:16.650607 (+ 128us) client_negotiation.cc:240] Negotiation successful
0618 23:21:16.650868 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8570,"thread_start_us":571,"threads_started":1}
I20260618 23:21:16.652261 15514 heartbeater.cc:347] Connected to a master server at 127.3.217.190:32831
I20260618 23:21:16.652369 15514 heartbeater.cc:464] Registering TS with master...
I20260618 23:21:16.652567 15514 heartbeater.cc:511] Master 127.3.217.190:32831 requested a full tablet report, sending...
I20260618 23:21:16.652973 15164 ts_manager.cc:194] Registered new tserver with Master: 389708a885cc4c34ae635f9b6d118a45 (127.3.217.130:45469)
I20260618 23:21:16.653470 15164 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:55773
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
I20260618 23:21:16.679207 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.217.148:39641/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:32831
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:41937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:21:16.824260 15519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:21:16.824585 15519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:21:16.824628 15519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:21:16.826093 15519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:21:16.826159 15519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:21:16.826215 15519 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:21:16.827939 15519 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:41937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.3.217.148:39641/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:32831
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:21:16.828199 15519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:21:16.828429 15519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:21:16.834846 15525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:21:16.835480 15524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:21:16.835529 15527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:21:16.835979 15519 server_base.cc:1034] running on GCE node
I20260618 23:21:16.836170 15519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:21:16.836437 15519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:21:16.837613 15519 hybrid_clock.cc:648] HybridClock initialized: now 1781824876837587 us; error 43 us; skew 500 ppm
Jun 18 23:21:16 dist-test-slave-r9ct krb5kdc[14688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824876, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:21:16.840824 15519 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:21:16.841323 15519 webserver.cc:460] Webserver started at http://127.3.217.131:33583/ using document root <none> and password file <none>
I20260618 23:21:16.841548 15519 fs_manager.cc:359] Metadata directory not provided
I20260618 23:21:16.841611 15519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:21:16.841740 15519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 18 23:21:16 dist-test-slave-r9ct krb5kdc[14688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824876, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for HTTP/127.3.217.148@KRBTEST.COM
I20260618 23:21:16.856535 15519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "e177ed20655847a88f27392009fceeb7"
format_stamp: "Formatted at 2026-06-18 23:21:16 on dist-test-slave-r9ct"
server_key: "a065047ceb6bb3de32138357e4547bdc"
server_key_iv: "7a723683535a693404bf27c6b3e5ec4f"
server_key_version: "kuduclusterkey@0"
I20260618 23:21:16.857103 15519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "e177ed20655847a88f27392009fceeb7"
format_stamp: "Formatted at 2026-06-18 23:21:16 on dist-test-slave-r9ct"
server_key: "a065047ceb6bb3de32138357e4547bdc"
server_key_iv: "7a723683535a693404bf27c6b3e5ec4f"
server_key_version: "kuduclusterkey@0"
I20260618 23:21:16.859241 15519 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260618 23:21:16.886883 15534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:21:16.887080 15519 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260618 23:21:16.887204 15519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "e177ed20655847a88f27392009fceeb7"
format_stamp: "Formatted at 2026-06-18 23:21:16 on dist-test-slave-r9ct"
server_key: "a065047ceb6bb3de32138357e4547bdc"
server_key_iv: "7a723683535a693404bf27c6b3e5ec4f"
server_key_version: "kuduclusterkey@0"
I20260618 23:21:16.887387 15519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:21:16.899677 15519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:21:16.908457 15519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:21:16.908648 15519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:21:16.908855 15519 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:21:16.909235 15519 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:21:16.909289 15519 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:21:16.909328 15519 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:21:16.909358 15519 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:21:16.916656 15519 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:46021
I20260618 23:21:16.917091 15519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:21:16.917819 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 15519
I20260618 23:21:16.917924 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:21:16.918140 3942 external_mini_cluster.cc:1428] Setting key 8a4f2e56c14199f41839a97dce7e51f6
I20260618 23:21:16.924161 15647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:46021 every 8 connection(s)
Jun 18 23:21:16 dist-test-slave-r9ct krb5kdc[14688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824876, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:21:16.936379 15379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:21:16.925091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:55405 (local address 127.3.217.190:32831)
0618 23:21:16.925145 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0618 23:21:16.925148 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:21:16.925437 (+ 289us) server_negotiation.cc:407] Connection header received
0618 23:21:16.926122 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:21:16.926123 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:21:16.926135 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:21:16.926167 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:21:16.926995 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.927730 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.929485 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.929780 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.929827 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:21:16.932707 (+ 2880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:21:16.932709 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:21:16.932709 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:21:16.932718 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:21:16.934772 (+ 2054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:21:16.935273 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:21:16.935274 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:21:16.935275 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:21:16.935332 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:21:16.935643 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:21:16.935644 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:21:16.935645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:21:16.935784 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:21:16.935825 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0618 23:21:16.936195 (+ 370us) server_negotiation.cc:299] Negotiation successful
0618 23:21:16.936282 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260618 23:21:16.936932 15650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:21:16.924820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:32831 (local address 127.3.217.131:55405)
0618 23:21:16.925317 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0618 23:21:16.925361 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0618 23:21:16.925977 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:21:16.926345 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:21:16.926349 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:21:16.926586 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:21:16.926895 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:21:16.926900 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.927885 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.927886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:21:16.929283 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:21:16.929307 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.930040 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.930044 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:21:16.930237 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:21:16.930869 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:21:16.930878 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:21:16.932575 (+ 1697us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:21:16.934874 (+ 2299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:21:16.934880 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:21:16.934882 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:21:16.935180 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:21:16.935404 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:21:16.935405 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:21:16.935405 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:21:16.935553 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:21:16.935873 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:21:16.935879 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:21:16.936039 (+ 160us) client_negotiation.cc:769] Sending connection context
0618 23:21:16.936513 (+ 474us) client_negotiation.cc:240] Negotiation successful
0618 23:21:16.936697 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":89,"threads_started":1}
I20260618 23:21:16.937347 15648 heartbeater.cc:347] Connected to a master server at 127.3.217.190:32831
I20260618 23:21:16.937446 15648 heartbeater.cc:464] Registering TS with master...
I20260618 23:21:16.937649 15648 heartbeater.cc:511] Master 127.3.217.190:32831 requested a full tablet report, sending...
I20260618 23:21:16.937997 15164 ts_manager.cc:194] Registered new tserver with Master: e177ed20655847a88f27392009fceeb7 (127.3.217.131:46021)
I20260618 23:21:16.938486 15164 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:55405
I20260618 23:21:16.940461 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260618 23:21:16.950479 15379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:21:16.942076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43268 (local address 127.3.217.190:32831)
0618 23:21:16.942116 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0618 23:21:16.942117 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:21:16.942385 (+ 268us) server_negotiation.cc:407] Connection header received
0618 23:21:16.942473 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:21:16.942474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:21:16.942483 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:21:16.942510 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:21:16.943290 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.944043 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.945103 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.945355 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.945395 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:21:16.946900 (+ 1505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:21:16.946902 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:21:16.946902 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:21:16.946908 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:21:16.949151 (+ 2243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:21:16.949610 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:21:16.949611 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:21:16.949611 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:21:16.949665 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:21:16.949877 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:21:16.949878 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:21:16.949878 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:21:16.950000 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:21:16.950071 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0618 23:21:16.950290 (+ 219us) server_negotiation.cc:299] Negotiation successful
0618 23:21:16.950369 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260618 23:21:16.952427 15164 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43268:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:21:16.954831 15164 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:21:16.965492 15664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:21:16.957849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:46021 (local address 127.0.0.1:37596)
0618 23:21:16.959535 (+ 1686us) negotiation.cc:107] Waiting for socket to connect
0618 23:21:16.959594 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0618 23:21:16.959670 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:21:16.960112 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:21:16.960115 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:21:16.960117 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:21:16.960208 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:21:16.960210 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.962310 (+ 2100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.962312 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:21:16.964105 (+ 1793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:21:16.964108 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.965191 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.965192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:21:16.965280 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:21:16.965294 (+ 14us) client_negotiation.cc:769] Sending connection context
0618 23:21:16.965360 (+ 66us) client_negotiation.cc:240] Negotiation successful
0618 23:21:16.965413 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1645,"thread_start_us":203,"threads_started":1}
I20260618 23:21:16.965844 15666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:21:16.959005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37596 (local address 127.3.217.131:46021)
0618 23:21:16.959835 (+ 830us) server_negotiation.cc:206] Beginning negotiation
0618 23:21:16.959842 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0618 23:21:16.959852 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:21:16.959896 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:21:16.959899 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:21:16.959918 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:21:16.960023 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:21:16.960401 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.962149 (+ 1748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.964240 (+ 2091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.964998 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.965067 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:21:16.965154 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0618 23:21:16.965726 (+ 572us) server_negotiation.cc:299] Negotiation successful
0618 23:21:16.965770 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":790,"thread_start_us":91,"threads_started":1}
I20260618 23:21:16.966517 15582 tablet_service.cc:1467] Processing CreateTablet for tablet 3c9f44c2e0ef4a42bca0404a74f9cc3c (DEFAULT_TABLE table=test-table [id=3f759d5549b944de9d759662457805d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:21:16.967228 15582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c9f44c2e0ef4a42bca0404a74f9cc3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:21:16.971799 15667 tablet_bootstrap.cc:492] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P e177ed20655847a88f27392009fceeb7: Bootstrap starting.
I20260618 23:21:16.972692 15662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:21:16.958384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:45317 (local address 127.0.0.1:43434)
0618 23:21:16.960298 (+ 1914us) negotiation.cc:107] Waiting for socket to connect
0618 23:21:16.960306 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0618 23:21:16.960343 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:21:16.967049 (+ 6706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:21:16.967051 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:21:16.967053 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:21:16.967094 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:21:16.967095 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.969907 (+ 2812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.969908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:21:16.971358 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:21:16.971360 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.972410 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.972411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:21:16.972495 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:21:16.972500 (+ 5us) client_negotiation.cc:769] Sending connection context
0618 23:21:16.972567 (+ 67us) client_negotiation.cc:240] Negotiation successful
0618 23:21:16.972610 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1898,"thread_start_us":112,"threads_started":1}
I20260618 23:21:16.972906 15667 tablet_bootstrap.cc:654] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P e177ed20655847a88f27392009fceeb7: Neither blocks nor log segments found. Creating new log.
I20260618 23:21:16.973209 15667 log.cc:824] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P e177ed20655847a88f27392009fceeb7: Log is configured to *not* fsync() on all Append() calls
I20260618 23:21:16.973980 15667 tablet_bootstrap.cc:492] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P e177ed20655847a88f27392009fceeb7: No bootstrap required, opened a new log
I20260618 23:21:16.974054 15667 ts_tablet_manager.cc:1397] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P e177ed20655847a88f27392009fceeb7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:21:16.975426 15661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:21:16.958598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:45469 (local address 127.0.0.1:37502)
0618 23:21:16.961357 (+ 2759us) negotiation.cc:107] Waiting for socket to connect
0618 23:21:16.961366 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0618 23:21:16.961409 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:21:16.968651 (+ 7242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:21:16.968653 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:21:16.968654 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:21:16.968694 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:21:16.968695 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.972891 (+ 4196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.972892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:21:16.974017 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:21:16.974020 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.975195 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.975196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:21:16.975258 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:21:16.975263 (+ 5us) client_negotiation.cc:769] Sending connection context
0618 23:21:16.975316 (+ 53us) client_negotiation.cc:240] Negotiation successful
0618 23:21:16.975357 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2743,"thread_start_us":61,"threads_started":1}
I20260618 23:21:16.976728 15667 raft_consensus.cc:348] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P e177ed20655847a88f27392009fceeb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e177ed20655847a88f27392009fceeb7" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46021 } } peers { permanent_uuid: "86b6035d4ae6496a909367b57addd682" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45317 } } peers { permanent_uuid: "389708a885cc4c34ae635f9b6d118a45" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 45469 } }
I20260618 23:21:16.976898 15667 raft_consensus.cc:374] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P e177ed20655847a88f27392009fceeb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:21:16.976935 15667 raft_consensus.cc:729] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P e177ed20655847a88f27392009fceeb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e177ed20655847a88f27392009fceeb7, State: Initialized, Role: FOLLOWER
I20260618 23:21:16.977046 15667 consensus_queue.cc:260] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P e177ed20655847a88f27392009fceeb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e177ed20655847a88f27392009fceeb7" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46021 } } peers { permanent_uuid: "86b6035d4ae6496a909367b57addd682" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45317 } } peers { permanent_uuid: "389708a885cc4c34ae635f9b6d118a45" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 45469 } }
I20260618 23:21:16.977319 15667 ts_tablet_manager.cc:1428] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P e177ed20655847a88f27392009fceeb7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260618 23:21:16.977466 15648 heartbeater.cc:503] Master 127.3.217.190:32831 was elected leader, sending a full tablet report...
I20260618 23:21:16.982985 15665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:21:16.958777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37502 (local address 127.3.217.130:45469)
0618 23:21:16.968399 (+ 9622us) server_negotiation.cc:206] Beginning negotiation
0618 23:21:16.968404 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:21:16.968413 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:21:16.968451 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:21:16.968453 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:21:16.968469 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:21:16.968547 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:21:16.968776 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.969793 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.974164 (+ 4371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.975015 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.975079 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:21:16.975161 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0618 23:21:16.982832 (+ 7671us) server_negotiation.cc:299] Negotiation successful
0618 23:21:16.982890 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9579,"thread_start_us":94,"threads_started":1}
I20260618 23:21:16.982978 15663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:21:16.958501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43434 (local address 127.3.217.129:45317)
0618 23:21:16.966804 (+ 8303us) server_negotiation.cc:206] Beginning negotiation
0618 23:21:16.966809 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:21:16.966821 (+ 12us) server_negotiation.cc:407] Connection header received
0618 23:21:16.966860 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:21:16.966862 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:21:16.966880 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:21:16.966966 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:21:16.967188 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.968240 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.971467 (+ 3227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:21:16.972214 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:21:16.972298 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:21:16.972370 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0618 23:21:16.982820 (+ 10450us) server_negotiation.cc:299] Negotiation successful
0618 23:21:16.982890 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8261,"thread_start_us":55,"threads_started":1}
I20260618 23:21:16.984439 15448 tablet_service.cc:1467] Processing CreateTablet for tablet 3c9f44c2e0ef4a42bca0404a74f9cc3c (DEFAULT_TABLE table=test-table [id=3f759d5549b944de9d759662457805d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:21:16.985051 15448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c9f44c2e0ef4a42bca0404a74f9cc3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:21:16.987586 15310 tablet_service.cc:1467] Processing CreateTablet for tablet 3c9f44c2e0ef4a42bca0404a74f9cc3c (DEFAULT_TABLE table=test-table [id=3f759d5549b944de9d759662457805d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:21:16.988197 15310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c9f44c2e0ef4a42bca0404a74f9cc3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:21:16.991943 15670 tablet_bootstrap.cc:492] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 86b6035d4ae6496a909367b57addd682: Bootstrap starting.
I20260618 23:21:16.992733 15670 tablet_bootstrap.cc:654] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 86b6035d4ae6496a909367b57addd682: Neither blocks nor log segments found. Creating new log.
I20260618 23:21:16.993103 15670 log.cc:824] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 86b6035d4ae6496a909367b57addd682: Log is configured to *not* fsync() on all Append() calls
I20260618 23:21:16.993458 15671 tablet_bootstrap.cc:492] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45: Bootstrap starting.
I20260618 23:21:16.994505 15671 tablet_bootstrap.cc:654] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45: Neither blocks nor log segments found. Creating new log.
I20260618 23:21:16.995005 15671 log.cc:824] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45: Log is configured to *not* fsync() on all Append() calls
I20260618 23:21:16.995532 15670 tablet_bootstrap.cc:492] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 86b6035d4ae6496a909367b57addd682: No bootstrap required, opened a new log
I20260618 23:21:16.995639 15670 ts_tablet_manager.cc:1397] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 86b6035d4ae6496a909367b57addd682: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260618 23:21:16.998152 15670 raft_consensus.cc:348] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 86b6035d4ae6496a909367b57addd682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e177ed20655847a88f27392009fceeb7" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46021 } } peers { permanent_uuid: "86b6035d4ae6496a909367b57addd682" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45317 } } peers { permanent_uuid: "389708a885cc4c34ae635f9b6d118a45" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 45469 } }
I20260618 23:21:16.998373 15670 raft_consensus.cc:374] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 86b6035d4ae6496a909367b57addd682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:21:16.998445 15670 raft_consensus.cc:729] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 86b6035d4ae6496a909367b57addd682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b6035d4ae6496a909367b57addd682, State: Initialized, Role: FOLLOWER
I20260618 23:21:16.998638 15670 consensus_queue.cc:260] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 86b6035d4ae6496a909367b57addd682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e177ed20655847a88f27392009fceeb7" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46021 } } peers { permanent_uuid: "86b6035d4ae6496a909367b57addd682" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45317 } } peers { permanent_uuid: "389708a885cc4c34ae635f9b6d118a45" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 45469 } }
I20260618 23:21:16.999086 15670 ts_tablet_manager.cc:1428] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 86b6035d4ae6496a909367b57addd682: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260618 23:21:16.999240 15376 heartbeater.cc:503] Master 127.3.217.190:32831 was elected leader, sending a full tablet report...
I20260618 23:21:17.001081 15671 tablet_bootstrap.cc:492] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45: No bootstrap required, opened a new log
I20260618 23:21:17.001206 15671 ts_tablet_manager.cc:1397] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260618 23:21:17.003218 15671 raft_consensus.cc:348] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e177ed20655847a88f27392009fceeb7" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46021 } } peers { permanent_uuid: "86b6035d4ae6496a909367b57addd682" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45317 } } peers { permanent_uuid: "389708a885cc4c34ae635f9b6d118a45" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 45469 } }
I20260618 23:21:17.003460 15671 raft_consensus.cc:374] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:21:17.003535 15671 raft_consensus.cc:729] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389708a885cc4c34ae635f9b6d118a45, State: Initialized, Role: FOLLOWER
I20260618 23:21:17.003734 15671 consensus_queue.cc:260] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e177ed20655847a88f27392009fceeb7" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46021 } } peers { permanent_uuid: "86b6035d4ae6496a909367b57addd682" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45317 } } peers { permanent_uuid: "389708a885cc4c34ae635f9b6d118a45" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 45469 } }
I20260618 23:21:17.004033 15671 ts_tablet_manager.cc:1428] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260618 23:21:17.004179 15514 heartbeater.cc:503] Master 127.3.217.190:32831 was elected leader, sending a full tablet report...
I20260618 23:21:17.005910 15676 raft_consensus.cc:482] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:21:17.006060 15676 raft_consensus.cc:504] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e177ed20655847a88f27392009fceeb7" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46021 } } peers { permanent_uuid: "86b6035d4ae6496a909367b57addd682" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45317 } } peers { permanent_uuid: "389708a885cc4c34ae635f9b6d118a45" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 45469 } }
I20260618 23:21:17.010095 15516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:21:17.006547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:46021 (local address 127.3.217.130:60069)
0618 23:21:17.006603 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0618 23:21:17.006617 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0618 23:21:17.006686 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:21:17.006905 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:21:17.006906 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:21:17.006908 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:21:17.006967 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:21:17.006968 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:21:17.007892 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:21:17.007893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:21:17.009076 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:21:17.009079 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:21:17.009858 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:21:17.009859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:21:17.009939 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:21:17.009942 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:21:17.009987 (+ 45us) client_negotiation.cc:240] Negotiation successful
0618 23:21:17.010025 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260618 23:21:17.010533 15666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:21:17.006678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:60069 (local address 127.3.217.131:46021)
0618 23:21:17.006755 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0618 23:21:17.006757 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:21:17.006766 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:21:17.006791 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:21:17.006792 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:21:17.006801 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:21:17.006855 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:21:17.007033 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:21:17.007782 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:21:17.009192 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:21:17.009752 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:21:17.009818 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:21:17.009826 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0618 23:21:17.010426 (+ 600us) server_negotiation.cc:299] Negotiation successful
0618 23:21:17.010467 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260618 23:21:17.010886 15602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c9f44c2e0ef4a42bca0404a74f9cc3c" candidate_uuid: "389708a885cc4c34ae635f9b6d118a45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e177ed20655847a88f27392009fceeb7" is_pre_election: true
I20260618 23:21:17.011034 15602 raft_consensus.cc:2454] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P e177ed20655847a88f27392009fceeb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389708a885cc4c34ae635f9b6d118a45 in term 0.
I20260618 23:21:17.011389 15404 leader_election.cc:302] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389708a885cc4c34ae635f9b6d118a45, e177ed20655847a88f27392009fceeb7; no voters:
I20260618 23:21:17.012020 15676 leader_election.cc:288] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e177ed20655847a88f27392009fceeb7 (127.3.217.131:46021), 86b6035d4ae6496a909367b57addd682 (127.3.217.129:45317)
I20260618 23:21:17.012146 15676 raft_consensus.cc:2781] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:21:17.012507 15676 raft_consensus.cc:482] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:21:17.012780 15676 raft_consensus.cc:3037] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:21:17.013943 15676 raft_consensus.cc:504] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e177ed20655847a88f27392009fceeb7" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46021 } } peers { permanent_uuid: "86b6035d4ae6496a909367b57addd682" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45317 } } peers { permanent_uuid: "389708a885cc4c34ae635f9b6d118a45" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 45469 } }
I20260618 23:21:17.014365 15602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c9f44c2e0ef4a42bca0404a74f9cc3c" candidate_uuid: "389708a885cc4c34ae635f9b6d118a45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e177ed20655847a88f27392009fceeb7"
I20260618 23:21:17.014453 15602 raft_consensus.cc:3037] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P e177ed20655847a88f27392009fceeb7 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:21:17.015425 15602 raft_consensus.cc:2454] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P e177ed20655847a88f27392009fceeb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389708a885cc4c34ae635f9b6d118a45 in term 1.
I20260618 23:21:17.015645 15404 leader_election.cc:302] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389708a885cc4c34ae635f9b6d118a45, e177ed20655847a88f27392009fceeb7; no voters:
I20260618 23:21:17.015774 15516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:21:17.011768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:45317 (local address 127.3.217.130:38377)
0618 23:21:17.011922 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0618 23:21:17.011933 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:21:17.011970 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:21:17.012664 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:21:17.012665 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:21:17.012667 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:21:17.012703 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:21:17.012704 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:21:17.013594 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:21:17.013595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:21:17.014737 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:21:17.014739 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:21:17.015553 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:21:17.015554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:21:17.015613 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:21:17.015616 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:21:17.015660 (+ 44us) client_negotiation.cc:240] Negotiation successful
0618 23:21:17.015707 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136}
I20260618 23:21:17.015959 15676 leader_election.cc:288] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45 [CANDIDATE]: Term 1 election: Requested vote from peers e177ed20655847a88f27392009fceeb7 (127.3.217.131:46021), 86b6035d4ae6496a909367b57addd682 (127.3.217.129:45317)
I20260618 23:21:17.016070 15663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:21:17.011873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:38377 (local address 127.3.217.129:45317)
0618 23:21:17.012484 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0618 23:21:17.012486 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:21:17.012496 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:21:17.012521 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:21:17.012522 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:21:17.012531 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:21:17.012602 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:21:17.012772 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:21:17.013489 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:21:17.014831 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:21:17.015441 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:21:17.015514 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:21:17.015522 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0618 23:21:17.015946 (+ 424us) server_negotiation.cc:299] Negotiation successful
0618 23:21:17.015990 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586}
I20260618 23:21:17.016330 15329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c9f44c2e0ef4a42bca0404a74f9cc3c" candidate_uuid: "389708a885cc4c34ae635f9b6d118a45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b6035d4ae6496a909367b57addd682" is_pre_election: true
I20260618 23:21:17.016463 15329 raft_consensus.cc:2454] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 86b6035d4ae6496a909367b57addd682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389708a885cc4c34ae635f9b6d118a45 in term 0.
I20260618 23:21:17.016561 15328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c9f44c2e0ef4a42bca0404a74f9cc3c" candidate_uuid: "389708a885cc4c34ae635f9b6d118a45" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b6035d4ae6496a909367b57addd682"
I20260618 23:21:17.016603 15328 raft_consensus.cc:3037] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 86b6035d4ae6496a909367b57addd682 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:21:17.017393 15328 raft_consensus.cc:2454] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 86b6035d4ae6496a909367b57addd682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389708a885cc4c34ae635f9b6d118a45 in term 1.
I20260618 23:21:17.015779 15675 raft_consensus.cc:2781] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:21:17.017768 15675 raft_consensus.cc:686] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45 [term 1 LEADER]: Becoming Leader. State: Replica: 389708a885cc4c34ae635f9b6d118a45, State: Running, Role: LEADER
I20260618 23:21:17.017858 15675 consensus_queue.cc:237] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e177ed20655847a88f27392009fceeb7" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46021 } } peers { permanent_uuid: "86b6035d4ae6496a909367b57addd682" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45317 } } peers { permanent_uuid: "389708a885cc4c34ae635f9b6d118a45" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 45469 } }
I20260618 23:21:17.018666 15163 catalog_manager.cc:5495] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389708a885cc4c34ae635f9b6d118a45 (127.3.217.130). New cstate: current_term: 1 leader_uuid: "389708a885cc4c34ae635f9b6d118a45" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e177ed20655847a88f27392009fceeb7" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86b6035d4ae6496a909367b57addd682" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389708a885cc4c34ae635f9b6d118a45" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 45469 } health_report { overall_health: HEALTHY } } }
I20260618 23:21:17.037586 15665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:21:17.033707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37518 (local address 127.3.217.130:45469)
0618 23:21:17.033746 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0618 23:21:17.033748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:21:17.033755 (+ 7us) server_negotiation.cc:407] Connection header received
0618 23:21:17.033793 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:21:17.033793 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:21:17.033815 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:21:17.033878 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:21:17.034061 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:21:17.034841 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:21:17.035908 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:21:17.036211 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:21:17.036266 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:21:17.036436 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:21:17.036574 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:21:17.036644 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0618 23:21:17.037448 (+ 804us) server_negotiation.cc:299] Negotiation successful
0618 23:21:17.037471 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260618 23:21:17.039953 15328 raft_consensus.cc:1261] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 86b6035d4ae6496a909367b57addd682 [term 1 FOLLOWER]: Refusing update from remote peer 389708a885cc4c34ae635f9b6d118a45: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:21:17.040254 15602 raft_consensus.cc:1261] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P e177ed20655847a88f27392009fceeb7 [term 1 FOLLOWER]: Refusing update from remote peer 389708a885cc4c34ae635f9b6d118a45: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:21:17.040699 15676 consensus_queue.cc:1035] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e177ed20655847a88f27392009fceeb7" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:21:17.041108 15676 consensus_queue.cc:1035] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b6035d4ae6496a909367b57addd682" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:21:17.048025 15679 mvcc.cc:205] Tried to move back new op lower bound from 7298354696352038912 to 7298354696265826304. Current Snapshot: MvccSnapshot[applied={T|T < 7298354696352038912}]
I20260618 23:21:17.048296 15680 mvcc.cc:205] Tried to move back new op lower bound from 7298354696352038912 to 7298354696265826304. Current Snapshot: MvccSnapshot[applied={T|T < 7298354696352038912}]
I20260618 23:21:17.050309 15682 mvcc.cc:205] Tried to move back new op lower bound from 7298354696352038912 to 7298354696265826304. Current Snapshot: MvccSnapshot[applied={T|T < 7298354696352038912}]
I20260618 23:21:17.053269 15163 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:21:17.053371 15163 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:21:17.054216 15163 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9e50512407c9452eb71edd819f819583: Sending DeleteTablet for 3 replicas of tablet 3c9f44c2e0ef4a42bca0404a74f9cc3c
I20260618 23:21:17.054795 15582 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c9f44c2e0ef4a42bca0404a74f9cc3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:21:17 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:37596
I20260618 23:21:17.055027 15310 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c9f44c2e0ef4a42bca0404a74f9cc3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:21:17 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:43434
I20260618 23:21:17.055230 15448 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c9f44c2e0ef4a42bca0404a74f9cc3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:21:17 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:37502
I20260618 23:21:17.056202 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 15245
I20260618 23:21:17.060953 15688 tablet_replica.cc:330] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P e177ed20655847a88f27392009fceeb7: stopping tablet replica
I20260618 23:21:17.064924 15690 tablet_replica.cc:330] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45: stopping tablet replica
I20260618 23:21:17.065163 15690 raft_consensus.cc:2229] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45 [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:21:17.065330 15688 raft_consensus.cc:2229] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P e177ed20655847a88f27392009fceeb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:21:17.065546 15690 raft_consensus.cc:2258] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:21:17.065712 15688 raft_consensus.cc:2258] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P e177ed20655847a88f27392009fceeb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:21:17.066484 15690 ts_tablet_manager.cc:1905] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:21:17.066808 15688 ts_tablet_manager.cc:1905] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P e177ed20655847a88f27392009fceeb7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:21:17.074097 15690 ts_tablet_manager.cc:1918] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:21:17.074252 15690 log.cc:1196] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/3c9f44c2e0ef4a42bca0404a74f9cc3c
I20260618 23:21:17.074604 15690 ts_tablet_manager.cc:1939] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P 389708a885cc4c34ae635f9b6d118a45: Deleting consensus metadata
I20260618 23:21:17.074855 15688 ts_tablet_manager.cc:1918] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P e177ed20655847a88f27392009fceeb7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:21:17.074935 15688 log.cc:1196] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P e177ed20655847a88f27392009fceeb7: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/3c9f44c2e0ef4a42bca0404a74f9cc3c
I20260618 23:21:17.075385 15149 catalog_manager.cc:4841] TS 389708a885cc4c34ae635f9b6d118a45 (127.3.217.130:45469): tablet 3c9f44c2e0ef4a42bca0404a74f9cc3c (table test-table [id=3f759d5549b944de9d759662457805d1]) successfully deleted
I20260618 23:21:17.075598 15688 ts_tablet_manager.cc:1939] T 3c9f44c2e0ef4a42bca0404a74f9cc3c P e177ed20655847a88f27392009fceeb7: Deleting consensus metadata
W20260618 23:21:17.075670 15149 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.217.129:45317 (error 108)
I20260618 23:21:17.076165 15151 catalog_manager.cc:4841] TS e177ed20655847a88f27392009fceeb7 (127.3.217.131:46021): tablet 3c9f44c2e0ef4a42bca0404a74f9cc3c (table test-table [id=3f759d5549b944de9d759662457805d1]) successfully deleted
I20260618 23:21:17.078562 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 15384
I20260618 23:21:17.081843 15661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:21:17.081497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:45317 (local address 127.0.0.1:43448)
0618 23:21:17.081728 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0618 23:21:17.081802 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.129:45317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182}
W20260618 23:21:17.082005 15149 catalog_manager.cc:4584] TS 86b6035d4ae6496a909367b57addd682 (127.3.217.129:45317): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3c9f44c2e0ef4a42bca0404a74f9cc3c: Network error: Client connection negotiation failed: client connection to 127.3.217.129:45317: connect: Connection refused (error 111)
I20260618 23:21:17.087798 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 15519
I20260618 23:21:17.095407 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 15132
I20260618 23:21:17.103838 3942 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260618 23:21:17.448702 3942 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260618 23:21:17.448814 3942 mini_ranger.cc:66] Stopping Ranger...
I20260618 23:21:17.794149 3942 mini_ranger.cc:68] Stopped Ranger
2026-06-18 23:21:17.794 UTC [14718] LOG: received smart shutdown request
2026-06-18 23:21:17.799 UTC [14718] LOG: background worker "logical replication launcher" (PID 14727) exited with exit code 1
2026-06-18 23:21:17.799 UTC [14722] LOG: shutting down
2026-06-18 23:21:18.014 UTC [14718] LOG: database system is shut down
2026-06-18T23:21:18Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (50347 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:21:18 dist-test-slave-r9ct krb5kdc[15700](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:21:18 dist-test-slave-r9ct krb5kdc[15700](info): set up 2 sockets
Jun 18 23:21:18 dist-test-slave-r9ct krb5kdc[15700](info): commencing operation
krb5kdc: starting...
W20260618 23:21:19.198593 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:21:19 dist-test-slave-r9ct krb5kdc[15700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:21:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:21:19Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.3.217.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.3.217.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.3.217.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/rangeradmin_127.3.217.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.3.217.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/rangeradmin_127.3.217.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.3.217.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.3.217.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.3.217.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/rangerlookup_127.3.217.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.3.217.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/rangerlookup_127.3.217.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.3.217.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.3.217.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.3.217.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/HTTP_127.3.217.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.3.217.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/HTTP_127.3.217.148@KRBTEST.COM.keytab.
I20260618 23:21:19.395300 3942 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskY_cj0P/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/postgres -l logfile start
2026-06-18 23:21:22.688 UTC [15730] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-06-18 23:21:22.688 UTC [15730] LOG: listening on IPv4 address "127.3.217.148", port 37421
2026-06-18 23:21:22.693 UTC [15730] LOG: listening on Unix socket "/tmp/.s.PGSQL.37421"
2026-06-18 23:21:22.717 UTC [15733] LOG: database system was shut down at 2026-06-18 23:21:20 UTC
2026-06-18 23:21:22.723 UTC [15730] LOG: database system is ready to accept connections
I20260618 23:21:23.706835 3942 mini_postgres.cc:96] Postgres bound to 37421
2026-06-18 23:21:23.714 UTC [15741] FATAL: database "slave" does not exist
127.3.217.148:37421 - accepting connections
I20260618 23:21:23.714632 3942 mini_ranger.cc:161] Starting Ranger...
I20260618 23:21:23.731959 3942 mini_ranger.cc:84] Created miniranger Postgres user
I20260618 23:21:24.359443 3942 mini_ranger.cc:87] Created ranger Postgres database
I20260618 23:21:24.359541 3942 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ranger-admin
2026-06-18 23:21:24,636 [I] DB FLAVOR :POSTGRES
2026-06-18 23:21:24,637 [I] --------- Verifying Ranger DB connection ---------
2026-06-18 23:21:24,637 [I] Checking connection..
2026-06-18 23:21:24,637 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-06-18 23:21:24,895 [I] Checking connection passed.
2026-06-18 23:21:24,895 [I] --------- Verifying version history table ---------
2026-06-18 23:21:24,895 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-18 23:21:25,146 [I] Table x_db_version_h does not exist in database ranger
2026-06-18 23:21:25,147 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-18 23:21:25,401 [I] Table x_db_version_h does not exist in database ranger
2026-06-18 23:21:25,401 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-06-18 23:21:25,401 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-06-18 23:21:25.675 UTC [15805] WARNING: there is no transaction in progress
2026-06-18 23:21:25,683 [I] create_dbversion_catalog.sql file imported successfully
2026-06-18 23:21:25,683 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-18 23:21:25,951 [I] Table x_db_version_h already exists in database 'ranger'
2026-06-18 23:21:25,951 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-18 23:21:25,951 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-06-18 23:21:26,214 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-06-18 23:21:26,462 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-r9ct.c.gcp-upstream.internal','N') ;"
2026-06-18 23:21:26,713 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-18 23:21:26,984 [I] Table x_portal_user does not exist in database ranger
2026-06-18 23:21:26,985 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-18 23:21:27,236 [I] Table x_policy_ref_group does not exist in database ranger
2026-06-18 23:21:27,236 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-18 23:21:27,478 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-18 23:21:27,725 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-06-18 23:21:27,725 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-06-18 23:21:28.848 UTC [15913] WARNING: there is no transaction in progress
2026-06-18 23:21:28.867 UTC [15913] WARNING: there is no transaction in progress
2026-06-18 23:21:28.887 UTC [15913] WARNING: there is no transaction in progress
2026-06-18 23:21:28.905 UTC [15913] WARNING: there is no transaction in progress
2026-06-18 23:21:28.923 UTC [15913] WARNING: there is no transaction in progress
2026-06-18 23:21:28.943 UTC [15913] WARNING: there is no transaction in progress
2026-06-18 23:21:29.007 UTC [15913] WARNING: there is no transaction in progress
2026-06-18 23:21:29.015 UTC [15913] WARNING: there is no transaction in progress
2026-06-18 23:21:29.034 UTC [15913] WARNING: there is no transaction in progress
2026-06-18 23:21:29.047 UTC [15913] WARNING: there is no transaction in progress
2026-06-18 23:21:29.060 UTC [15913] WARNING: there is no transaction in progress
2026-06-18 23:21:29.076 UTC [15913] WARNING: there is no transaction in progress
2026-06-18 23:21:29.087 UTC [15913] WARNING: there is no transaction in progress
2026-06-18 23:21:29.096 UTC [15913] WARNING: there is no transaction in progress
2026-06-18 23:21:29.107 UTC [15913] WARNING: there is no transaction in progress
2026-06-18 23:21:29.117 UTC [15913] WARNING: there is no transaction in progress
2026-06-18 23:21:29,955 [I] ranger_core_db_postgres.sql file imported successfully
2026-06-18 23:21:29,956 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-06-18 23:21:30,210 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-06-18 23:21:30,211 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-18 23:21:30,461 [I] Table x_portal_user already exists in database 'ranger'
2026-06-18 23:21:30,461 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-18 23:21:30,713 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-06-18 23:21:30,713 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-18 23:21:30,987 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-18 23:21:31,259 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-r9ct.c.gcp-upstream.internal';"
2026-06-18 23:21:31,522 [I] CORE_DB_SCHEMA import status has been updated
2026-06-18 23:21:31,523 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-06-18 23:21:31,769 [I] DB_PATCHES have already been applied
I20260618 23:21:31.775067 3942 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ranger-admin:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskY_cj0P/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260618 23:21:31.775132 3942 mini_ranger.cc:193] Using host: 127.3.217.148
I20260618 23:21:31.778460 3942 mini_ranger.cc:227] Ranger admin URL: http://127.3.217.148:51591
Jun 18, 2026 11:21:32 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 18, 2026 11:21:32 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 18, 2026 11:21:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ranger-admin/ews/webapp
Jun 18, 2026 11:21:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Jun 18, 2026 11:21:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ranger-admin/ews/webapp] .....
Jun 18, 2026 11:21:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ranger-admin/ews/webapp].
Jun 18, 2026 11:21:32 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260618 23:21:32.938457 3942 mini_ranger.cc:160] Time spent starting Ranger: real 9.224s user 0.000s sys 0.009s
Jun 18, 2026 11:21:54 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Jun 18, 2026 11:21:54 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Jun 18, 2026 11:21:54 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Jun 18, 2026 11:21:54 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Jun 18, 2026 11:21:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Jun 18, 2026 11:21:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Jun 18, 2026 11:21:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Jun 18, 2026 11:21:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Jun 18, 2026 11:21:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Jun 18, 2026 11:21:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Jun 18, 2026 11:21:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Jun 18, 2026 11:21:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Jun 18, 2026 11:21:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Jun 18, 2026 11:21:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Jun 18, 2026 11:21:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Jun 18, 2026 11:21:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Jun 18, 2026 11:21:54 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Jun 18, 2026 11:21:55 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260618 23:21:55.932690 3942 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.3.217.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.3.217.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.3.217.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/rangerkms_127.3.217.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.3.217.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/rangerkms_127.3.217.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.3.217.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.3.217.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.3.217.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/HTTP_127.3.217.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.3.217.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/HTTP_127.3.217.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Jun 18 23:21:56 dist-test-slave-r9ct krb5kdc[15700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824916, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260618 23:21:56.016361 3942 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260618 23:21:56.025995 3942 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260618 23:21:56.999293 3942 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260618 23:21:56.999408 3942 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ranger-kms
I20260618 23:21:56.999432 3942 mini_ranger_kms.cc:227] Using postgres at 127.3.217.148:37421
2026-06-18 23:21:57,172 [I] DB FLAVOR :POSTGRES
2026-06-18 23:21:57,172 [I] --------- Verifying Ranger DB connection ---------
2026-06-18 23:21:57,172 [I] Checking connection
2026-06-18 23:21:57,172 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-06-18 23:21:57,420 [I] connection success
2026-06-18 23:21:57,421 [I] --------- Verifying Ranger DB tables ---------
2026-06-18 23:21:57,421 [I] Verifying table ranger_masterkey in database rangerkms
2026-06-18 23:21:57,421 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-06-18 23:21:57,665 [I] Table ranger_masterkey does not exist in database rangerkms
2026-06-18 23:21:57,666 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-18 23:21:57,666 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-06-18 23:21:57,666 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.217.148:37421/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-06-18 23:21:57,945 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260618 23:21:58.475200 3942 mini_ranger_kms.cc:310] Created kms service
I20260618 23:21:58.672549 3942 mini_ranger_kms.cc:326] Created kudu user
I20260618 23:21:58.713464 3942 mini_ranger_kms.cc:343] Created rangerkms user
Jun 18 23:21:58 dist-test-slave-r9ct krb5kdc[15700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824916, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.3.217.148@KRBTEST.COM
I20260618 23:21:59.156148 3942 mini_ranger_kms.cc:384] Added ranger policy
I20260618 23:21:59.156409 3942 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ranger-kms:/tmp/dist-test-taskY_cj0P/build/release/bin/postgresql.jar:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskY_cj0P/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260618 23:21:59.156435 3942 mini_ranger_kms.cc:240] Using host: 127.3.217.148
I20260618 23:21:59.159898 3942 mini_ranger_kms.cc:276] Ranger KMS PID: 16094
I20260618 23:21:59.159981 3942 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.3.217.148:58023
Jun 18, 2026 11:22:00 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 18, 2026 11:22:00 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 18, 2026 11:22:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Jun 18, 2026 11:22:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ranger-kms/ews/webapp] .....
Jun 18, 2026 11:22:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ranger-kms/ews/webapp].
Jun 18, 2026 11:22:00 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Jun 18 23:22:01 dist-test-slave-r9ct krb5kdc[15700](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781824921, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.3.217.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:01.482920 3942 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.467s user 0.010s sys 0.143s
I20260618 23:22:01.483014 3942 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260618 23:22:01.483060 3942 mini_ranger_kms.cc:401] 127.3.217.148:58023/kms/v1/keys
Jun 18 23:22:01 dist-test-slave-r9ct krb5kdc[15700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824921, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.3.217.148@KRBTEST.COM for HTTP/127.3.217.148@KRBTEST.COM
Jun 18 23:22:01 dist-test-slave-r9ct krb5kdc[15700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824921, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.3.217.148@KRBTEST.COM for HTTP/127.3.217.148@KRBTEST.COM
Jun 18 23:22:04 dist-test-slave-r9ct krb5kdc[15700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824924, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:22:04.123040 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:36707
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:35193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:36707
--ranger_config_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.217.148:58023/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:22:04.219609 16144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:04.219815 16144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:04.219837 16144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:04.221099 16144 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:22:04.221150 16144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:04.221166 16144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:04.221179 16144 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:22:04.221191 16144 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:22:04.222858 16144 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:35193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/wal
--ranger_kms_url=127.3.217.148:58023/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:36707
--ranger_config_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:36707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16144
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:04.223085 16144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:04.223330 16144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:04.229737 16149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:04.229820 16150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:04.229929 16144 server_base.cc:1034] running on GCE node
W20260618 23:22:04.230120 16152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:04.230428 16144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:04.230935 16144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:04.232280 16144 hybrid_clock.cc:648] HybridClock initialized: now 1781824924232255 us; error 41 us; skew 500 ppm
Jun 18 23:22:04 dist-test-slave-r9ct krb5kdc[15700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824924, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:04.234980 16144 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:22:04.235514 16144 webserver.cc:460] Webserver started at http://127.3.217.190:45041/ using document root <none> and password file <none>
I20260618 23:22:04.235756 16144 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:04.235797 16144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:04.235930 16144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 18 23:22:04 dist-test-slave-r9ct krb5kdc[15700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824924, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for HTTP/127.3.217.148@KRBTEST.COM
I20260618 23:22:04.300041 16144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "60f0cb086406473a90b78c1cbe8c33d7"
format_stamp: "Formatted at 2026-06-18 23:22:04 on dist-test-slave-r9ct"
server_key: "f5b209daa5130cfe57bc62a9e429edac"
server_key_iv: "d547ea7ed929f3c06e1bb89c3327a51b"
server_key_version: "kuduclusterkey@0"
I20260618 23:22:04.300493 16144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "60f0cb086406473a90b78c1cbe8c33d7"
format_stamp: "Formatted at 2026-06-18 23:22:04 on dist-test-slave-r9ct"
server_key: "f5b209daa5130cfe57bc62a9e429edac"
server_key_iv: "d547ea7ed929f3c06e1bb89c3327a51b"
server_key_version: "kuduclusterkey@0"
I20260618 23:22:04.303002 16144 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260618 23:22:04.316447 16159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:04.316665 16144 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260618 23:22:04.316766 16144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "60f0cb086406473a90b78c1cbe8c33d7"
format_stamp: "Formatted at 2026-06-18 23:22:04 on dist-test-slave-r9ct"
server_key: "f5b209daa5130cfe57bc62a9e429edac"
server_key_iv: "d547ea7ed929f3c06e1bb89c3327a51b"
server_key_version: "kuduclusterkey@0"
I20260618 23:22:04.316880 16144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:04.334450 16144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:04.336452 16144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:04.336601 16144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:04.341751 16144 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:36707
I20260618 23:22:04.341774 16211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:36707 every 8 connection(s)
I20260618 23:22:04.342137 16144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:22:04.342891 16212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:04.344080 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 16144
I20260618 23:22:04.344206 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:22:04.344404 3942 external_mini_cluster.cc:1428] Setting key df9823f08f3926d47d964883ce03c786
I20260618 23:22:04.345615 16212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7: Bootstrap starting.
I20260618 23:22:04.346195 16212 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7: Neither blocks nor log segments found. Creating new log.
I20260618 23:22:04.346490 16212 log.cc:824] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:04.347280 16212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7: No bootstrap required, opened a new log
I20260618 23:22:04.349170 16212 raft_consensus.cc:348] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60f0cb086406473a90b78c1cbe8c33d7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 36707 } }
I20260618 23:22:04.349341 16212 raft_consensus.cc:374] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:22:04.349376 16212 raft_consensus.cc:729] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60f0cb086406473a90b78c1cbe8c33d7, State: Initialized, Role: FOLLOWER
I20260618 23:22:04.349522 16212 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60f0cb086406473a90b78c1cbe8c33d7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 36707 } }
I20260618 23:22:04.349594 16212 raft_consensus.cc:388] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:22:04.349622 16212 raft_consensus.cc:482] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:22:04.349684 16212 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:22:04.350409 16212 raft_consensus.cc:504] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60f0cb086406473a90b78c1cbe8c33d7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 36707 } }
I20260618 23:22:04.350517 16212 leader_election.cc:302] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 60f0cb086406473a90b78c1cbe8c33d7; no voters:
I20260618 23:22:04.350730 16212 leader_election.cc:288] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:22:04.350793 16217 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:22:04.351013 16217 raft_consensus.cc:686] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [term 1 LEADER]: Becoming Leader. State: Replica: 60f0cb086406473a90b78c1cbe8c33d7, State: Running, Role: LEADER
I20260618 23:22:04.351069 16212 sys_catalog.cc:564] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:22:04.351178 16217 consensus_queue.cc:237] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60f0cb086406473a90b78c1cbe8c33d7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 36707 } }
I20260618 23:22:04.351500 16217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "60f0cb086406473a90b78c1cbe8c33d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60f0cb086406473a90b78c1cbe8c33d7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 36707 } } }
I20260618 23:22:04.351579 16217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [sys.catalog]: This master's current role is: LEADER
I20260618 23:22:04.351712 16217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 60f0cb086406473a90b78c1cbe8c33d7. Latest consensus state: current_term: 1 leader_uuid: "60f0cb086406473a90b78c1cbe8c33d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60f0cb086406473a90b78c1cbe8c33d7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 36707 } } }
I20260618 23:22:04.351783 16217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [sys.catalog]: This master's current role is: LEADER
I20260618 23:22:04.351897 16221 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:22:04.352422 16221 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:22:04.352998 16212 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Jun 18 23:22:04 dist-test-slave-r9ct krb5kdc[15700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824924, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:04.363854 16215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:04.344951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43904 (local address 127.3.217.190:36707)
0618 23:22:04.345154 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:04.345164 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:04.346911 (+ 1747us) server_negotiation.cc:407] Connection header received
0618 23:22:04.347415 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:04.347423 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:04.347483 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:04.347630 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:04.348325 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:04.349829 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:04.350612 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:04.351279 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:04.351359 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:04.355676 (+ 4317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:04.355738 (+ 62us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:04.355739 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:04.355830 (+ 91us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:04.359397 (+ 3567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:04.359850 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:04.359854 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:04.359854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:04.359966 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:04.360173 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:04.360174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:04.360174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:04.360518 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:04.360678 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:04.363007 (+ 2329us) server_negotiation.cc:299] Negotiation successful
0618 23:22:04.363468 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":91,"threads_started":1}
I20260618 23:22:04.369096 16221 catalog_manager.cc:1347] Generated new cluster ID: 756e5a3414e14bb9b8cf38be6f3a5e96
I20260618 23:22:04.369150 16221 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:22:04.377164 16221 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:22:04.378001 16221 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:22:04.386234 16221 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7: Generated new TSK 0
I20260618 23:22:04.386504 16221 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.217.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
I20260618 23:22:05.134202 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.217.148:58023/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:36707
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:35193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:22:05.237797 16257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:05.238029 16257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:05.238065 16257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:05.239302 16257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:05.239367 16257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:05.239413 16257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:22:05.240864 16257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:35193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.3.217.148:58023/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:36707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:05.241125 16257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:05.241350 16257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:05.247280 16262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:05.247524 16263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:05.247524 16265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:05.247977 16257 server_base.cc:1034] running on GCE node
I20260618 23:22:05.248307 16257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:05.248678 16257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:05.249940 16257 hybrid_clock.cc:648] HybridClock initialized: now 1781824925249896 us; error 54 us; skew 500 ppm
Jun 18 23:22:05 dist-test-slave-r9ct krb5kdc[15700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824925, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:05.257614 16257 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:22:05.258213 16257 webserver.cc:460] Webserver started at http://127.3.217.129:36105/ using document root <none> and password file <none>
I20260618 23:22:05.258491 16257 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:05.258577 16257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:05.258775 16257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 18 23:22:05 dist-test-slave-r9ct krb5kdc[15700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824925, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for HTTP/127.3.217.148@KRBTEST.COM
I20260618 23:22:05.277221 16257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "0dea600f942648df80c3af814ed63551"
format_stamp: "Formatted at 2026-06-18 23:22:05 on dist-test-slave-r9ct"
server_key: "7335db6ece884cd4b8b67d1fac879eed"
server_key_iv: "56cc39824e392e9389f12d824b63d23c"
server_key_version: "kuduclusterkey@0"
I20260618 23:22:05.277702 16257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "0dea600f942648df80c3af814ed63551"
format_stamp: "Formatted at 2026-06-18 23:22:05 on dist-test-slave-r9ct"
server_key: "7335db6ece884cd4b8b67d1fac879eed"
server_key_iv: "56cc39824e392e9389f12d824b63d23c"
server_key_version: "kuduclusterkey@0"
I20260618 23:22:05.280804 16257 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260618 23:22:05.300061 16274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:05.300323 16257 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260618 23:22:05.300411 16257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "0dea600f942648df80c3af814ed63551"
format_stamp: "Formatted at 2026-06-18 23:22:05 on dist-test-slave-r9ct"
server_key: "7335db6ece884cd4b8b67d1fac879eed"
server_key_iv: "56cc39824e392e9389f12d824b63d23c"
server_key_version: "kuduclusterkey@0"
I20260618 23:22:05.300495 16257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:05.324470 16257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:05.326967 16257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:05.327178 16257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:05.327451 16257 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:22:05.327854 16257 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:22:05.327943 16257 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:05.328047 16257 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:22:05.328119 16257 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:05.335546 16257 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:46561
I20260618 23:22:05.336019 16257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:22:05.341197 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 16257
I20260618 23:22:05.341315 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:22:05.341497 3942 external_mini_cluster.cc:1428] Setting key 591ff144e4a266fe929c573586adb4c7
I20260618 23:22:05.338528 16387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:46561 every 8 connection(s)
Jun 18 23:22:05 dist-test-slave-r9ct krb5kdc[15700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824925, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:05.352007 16390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:05.337967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:36707 (local address 127.3.217.129:54705)
0618 23:22:05.339203 (+ 1236us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:05.339322 (+ 119us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:05.339947 (+ 625us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:05.340569 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:05.340574 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:05.340816 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:05.341078 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:05.341084 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:05.343212 (+ 2128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:05.343213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:05.344909 (+ 1696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:05.344913 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:05.345469 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:05.345470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:05.345604 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:05.346252 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:05.346270 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:05.347963 (+ 1693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:05.350189 (+ 2226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:05.350207 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:05.350209 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:05.350516 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:05.350765 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:05.350765 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:05.350766 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:05.350899 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:05.351218 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:05.351224 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:05.351385 (+ 161us) client_negotiation.cc:769] Sending connection context
0618 23:22:05.351573 (+ 188us) client_negotiation.cc:240] Negotiation successful
0618 23:22:05.351751 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1195,"thread_start_us":78,"threads_started":1}
I20260618 23:22:05.353435 16391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:05.338357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:54705 (local address 127.3.217.190:36707)
0618 23:22:05.340132 (+ 1775us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:05.340135 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:05.340143 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:22:05.340169 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:05.340169 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:05.340182 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:05.340430 (+ 248us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:05.341196 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:05.343080 (+ 1884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:05.345009 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:05.345327 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:05.345389 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:05.348116 (+ 2727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:05.348117 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:05.348118 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:05.348126 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:05.350094 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:05.350606 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:05.350607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:05.350607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:05.350670 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:05.350977 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:05.350978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:05.350979 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:05.351116 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:05.351179 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:05.353132 (+ 1953us) server_negotiation.cc:299] Negotiation successful
0618 23:22:05.353314 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1747,"thread_start_us":70,"threads_started":1}
I20260618 23:22:05.354990 16388 heartbeater.cc:347] Connected to a master server at 127.3.217.190:36707
I20260618 23:22:05.355095 16388 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:05.355311 16388 heartbeater.cc:511] Master 127.3.217.190:36707 requested a full tablet report, sending...
I20260618 23:22:05.356094 16176 ts_manager.cc:194] Registered new tserver with Master: 0dea600f942648df80c3af814ed63551 (127.3.217.129:46561)
I20260618 23:22:05.357518 16176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:54705
WARNING: no policy specified for kudu/127.3.217.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
I20260618 23:22:05.400823 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.217.148:58023/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:36707
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:35193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 18 23:22:05 dist-test-slave-r9ct krb5kdc[15700](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781824925, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260618 23:22:05.532511 16396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:05.532799 16396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:05.532840 16396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:05.534574 16396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:05.534689 16396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:05.534799 16396 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:22:05.537043 16396 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:35193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.3.217.148:58023/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:36707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16396
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:05.537294 16396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:05.537629 16396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:05.546762 16405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:05.546967 16402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:05.548096 16403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:05.548334 16396 server_base.cc:1034] running on GCE node
I20260618 23:22:05.548666 16396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:05.548940 16396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:05.550109 16396 hybrid_clock.cc:648] HybridClock initialized: now 1781824925550086 us; error 38 us; skew 500 ppm
Jun 18 23:22:05 dist-test-slave-r9ct krb5kdc[15700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824925, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:05.554055 16396 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:22:05.554615 16396 webserver.cc:460] Webserver started at http://127.3.217.130:46871/ using document root <none> and password file <none>
I20260618 23:22:05.554934 16396 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:05.554997 16396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:05.555130 16396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 18 23:22:05 dist-test-slave-r9ct krb5kdc[15700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824925, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for HTTP/127.3.217.148@KRBTEST.COM
I20260618 23:22:05.573256 16396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "6c027df0f6c94d4e97f428bf8c0b6d40"
format_stamp: "Formatted at 2026-06-18 23:22:05 on dist-test-slave-r9ct"
server_key: "d83787c80a830469e3c68e5629d6de1b"
server_key_iv: "a1e82843578e23b23713a8516c6ca5ec"
server_key_version: "kuduclusterkey@0"
I20260618 23:22:05.573839 16396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "6c027df0f6c94d4e97f428bf8c0b6d40"
format_stamp: "Formatted at 2026-06-18 23:22:05 on dist-test-slave-r9ct"
server_key: "d83787c80a830469e3c68e5629d6de1b"
server_key_iv: "a1e82843578e23b23713a8516c6ca5ec"
server_key_version: "kuduclusterkey@0"
I20260618 23:22:05.578016 16396 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.001s
I20260618 23:22:05.604367 16412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:05.604669 16396 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.000s sys 0.001s
I20260618 23:22:05.604779 16396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "6c027df0f6c94d4e97f428bf8c0b6d40"
format_stamp: "Formatted at 2026-06-18 23:22:05 on dist-test-slave-r9ct"
server_key: "d83787c80a830469e3c68e5629d6de1b"
server_key_iv: "a1e82843578e23b23713a8516c6ca5ec"
server_key_version: "kuduclusterkey@0"
I20260618 23:22:05.604887 16396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:05.634899 16396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:05.637331 16396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:05.637529 16396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:05.637805 16396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:22:05.638207 16396 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:22:05.638289 16396 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:05.638361 16396 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:22:05.638418 16396 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:05.645169 16396 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:45197
I20260618 23:22:05.645660 16396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:22:05.649897 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 16396
I20260618 23:22:05.650007 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:22:05.650202 3942 external_mini_cluster.cc:1428] Setting key f21dade220a92e43c9eca47c03fcf431
I20260618 23:22:05.647692 16525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:45197 every 8 connection(s)
WARNING: no policy specified for kudu/127.3.217.131@KRBTEST.COM; defaulting to no policy
Jun 18 23:22:05 dist-test-slave-r9ct krb5kdc[15700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824925, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:05.675850 16391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:05.648914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:60921 (local address 127.3.217.190:36707)
0618 23:22:05.648976 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:05.648979 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:05.654975 (+ 5996us) server_negotiation.cc:407] Connection header received
0618 23:22:05.655591 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:05.655592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:05.655612 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:05.655681 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:05.656487 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:05.657302 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:05.665200 (+ 7898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:05.665543 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:05.665596 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:05.672407 (+ 6811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:05.672409 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:05.672410 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:05.672418 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:05.674162 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:05.674695 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:05.674697 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:05.674697 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:05.674792 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:05.675075 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:05.675076 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:05.675076 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:05.675219 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:05.675270 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:05.675638 (+ 368us) server_negotiation.cc:299] Negotiation successful
0618 23:22:05.675733 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260618 23:22:05.676625 16528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:05.648608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:36707 (local address 127.3.217.130:60921)
0618 23:22:05.654807 (+ 6199us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:05.654858 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:05.655478 (+ 620us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:05.655844 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:05.655849 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:05.656099 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:05.656376 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:05.656381 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:05.657421 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:05.657422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:05.658734 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:05.658737 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:05.665721 (+ 6984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:05.665722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:05.665908 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:05.666529 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:05.666539 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:05.672271 (+ 5732us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:05.674276 (+ 2005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:05.674283 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:05.674287 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:05.674595 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:05.674866 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:05.674866 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:05.674867 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:05.675003 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:05.675301 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:05.675307 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:05.675478 (+ 171us) client_negotiation.cc:769] Sending connection context
0618 23:22:05.676204 (+ 726us) client_negotiation.cc:240] Negotiation successful
0618 23:22:05.676383 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6148,"thread_start_us":89,"threads_started":1}
I20260618 23:22:05.677345 16526 heartbeater.cc:347] Connected to a master server at 127.3.217.190:36707
I20260618 23:22:05.677438 16526 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:05.677637 16526 heartbeater.cc:511] Master 127.3.217.190:36707 requested a full tablet report, sending...
I20260618 23:22:05.677991 16176 ts_manager.cc:194] Registered new tserver with Master: 6c027df0f6c94d4e97f428bf8c0b6d40 (127.3.217.130:45197)
I20260618 23:22:05.678474 16176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:60921
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
I20260618 23:22:05.698123 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.217.148:58023/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:36707
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:35193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:22:05.831936 16531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:05.832341 16531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:05.832432 16531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:05.834118 16531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:05.834343 16531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:05.834460 16531 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:22:05.836617 16531 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:35193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.3.217.148:58023/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:36707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16531
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:05.837090 16531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:05.837483 16531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:05.844563 16539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:05.844604 16537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:05.844775 16536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:05.844861 16531 server_base.cc:1034] running on GCE node
I20260618 23:22:05.848140 16531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:05.848479 16531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:05.849658 16531 hybrid_clock.cc:648] HybridClock initialized: now 1781824925849637 us; error 41 us; skew 500 ppm
Jun 18 23:22:05 dist-test-slave-r9ct krb5kdc[15700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824925, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:05.853427 16531 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:22:05.853988 16531 webserver.cc:460] Webserver started at http://127.3.217.131:42897/ using document root <none> and password file <none>
I20260618 23:22:05.854375 16531 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:05.854442 16531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:05.854571 16531 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 18 23:22:05 dist-test-slave-r9ct krb5kdc[15700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824925, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for HTTP/127.3.217.148@KRBTEST.COM
I20260618 23:22:05.876343 16531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "b852e988ef3e4996ab700ef1ee479ea9"
format_stamp: "Formatted at 2026-06-18 23:22:05 on dist-test-slave-r9ct"
server_key: "fa14a8ee81e4fa4490aca69fcd6a26fe"
server_key_iv: "d8332cfca1fccc42e1b95bcb63928cc1"
server_key_version: "kuduclusterkey@0"
I20260618 23:22:05.877158 16531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "b852e988ef3e4996ab700ef1ee479ea9"
format_stamp: "Formatted at 2026-06-18 23:22:05 on dist-test-slave-r9ct"
server_key: "fa14a8ee81e4fa4490aca69fcd6a26fe"
server_key_iv: "d8332cfca1fccc42e1b95bcb63928cc1"
server_key_version: "kuduclusterkey@0"
I20260618 23:22:05.885793 16531 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.000s sys 0.002s
I20260618 23:22:05.916265 16546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:05.916543 16531 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.002s
I20260618 23:22:05.916652 16531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "b852e988ef3e4996ab700ef1ee479ea9"
format_stamp: "Formatted at 2026-06-18 23:22:05 on dist-test-slave-r9ct"
server_key: "fa14a8ee81e4fa4490aca69fcd6a26fe"
server_key_iv: "d8332cfca1fccc42e1b95bcb63928cc1"
server_key_version: "kuduclusterkey@0"
I20260618 23:22:05.916744 16531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:05.937109 16531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:05.942493 16531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:05.942757 16531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:05.943064 16531 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:22:05.943475 16531 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:22:05.943573 16531 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:05.943648 16531 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:22:05.943717 16531 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:05.954535 16531 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:41157
I20260618 23:22:05.955094 16531 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:22:05.958133 16659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:41157 every 8 connection(s)
I20260618 23:22:05.959177 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 16531
I20260618 23:22:05.959311 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:22:05.959517 3942 external_mini_cluster.cc:1428] Setting key d03e82c4abced06eba868cb5e7400cd4
Jun 18 23:22:05 dist-test-slave-r9ct krb5kdc[15700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824925, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:05.971266 16391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:05.959633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:39087 (local address 127.3.217.190:36707)
0618 23:22:05.959869 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:05.959871 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:05.960577 (+ 706us) server_negotiation.cc:407] Connection header received
0618 23:22:05.961209 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:05.961210 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:05.961221 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:05.961250 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:05.962056 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:05.962868 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:05.964344 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:05.964640 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:05.964680 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:05.967451 (+ 2771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:05.967452 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:05.967453 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:05.967467 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:05.969067 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:05.969602 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:05.969603 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:05.969603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:05.969661 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:05.969935 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:05.969935 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:05.969936 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:05.970064 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:05.970105 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:05.971070 (+ 965us) server_negotiation.cc:299] Negotiation successful
0618 23:22:05.971155 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208}
I20260618 23:22:05.972040 16662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:05.959588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:36707 (local address 127.3.217.131:39087)
0618 23:22:05.960466 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:05.960512 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:05.961102 (+ 590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:05.961433 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:05.961439 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:05.961682 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:05.961950 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:05.961956 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:05.962976 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:05.962977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:05.964234 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:05.964237 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:05.964775 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:05.964775 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:05.964910 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:05.965513 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:05.965522 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:05.967211 (+ 1689us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:05.969175 (+ 1964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:05.969181 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:05.969183 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:05.969507 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:05.969733 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:05.969734 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:05.969734 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:05.969859 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:05.970155 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:05.970160 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:05.970328 (+ 168us) client_negotiation.cc:769] Sending connection context
0618 23:22:05.971632 (+ 1304us) client_negotiation.cc:240] Negotiation successful
0618 23:22:05.971807 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":836,"thread_start_us":83,"threads_started":1}
I20260618 23:22:05.972676 16660 heartbeater.cc:347] Connected to a master server at 127.3.217.190:36707
I20260618 23:22:05.972769 16660 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:05.972949 16660 heartbeater.cc:511] Master 127.3.217.190:36707 requested a full tablet report, sending...
I20260618 23:22:05.973291 16176 ts_manager.cc:194] Registered new tserver with Master: b852e988ef3e4996ab700ef1ee479ea9 (127.3.217.131:41157)
I20260618 23:22:05.973776 16176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:39087
I20260618 23:22:05.981743 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260618 23:22:05.982501 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 16257
I20260618 23:22:05.990146 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 16396
I20260618 23:22:05.996331 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 16531
I20260618 23:22:06.011864 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 16144
I20260618 23:22:06.019078 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:36707
--webserver_interface=127.3.217.190
--webserver_port=45041
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:35193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:36707
--ranger_config_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.217.148:58023/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.3.217.148:58023/kms with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:22:06.104133 16663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:06.104363 16663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:06.104385 16663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:06.105466 16663 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:22:06.105504 16663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:06.105518 16663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:06.105531 16663 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:22:06.105543 16663 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:22:06.107065 16663 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:35193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.3.217.148:58023/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:36707
--ranger_config_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:36707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=45041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:06.107259 16663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:06.107419 16663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:06.112457 16668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:06.112702 16663 server_base.cc:1034] running on GCE node
W20260618 23:22:06.112434 16671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:06.112434 16669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:06.113058 16663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:06.113366 16663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:06.114558 16663 hybrid_clock.cc:648] HybridClock initialized: now 1781824926114540 us; error 30 us; skew 500 ppm
Jun 18 23:22:06 dist-test-slave-r9ct krb5kdc[15700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824926, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:06.117334 16663 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:22:06.117760 16663 webserver.cc:460] Webserver started at http://127.3.217.190:45041/ using document root <none> and password file <none>
I20260618 23:22:06.117981 16663 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:06.118057 16663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 18 23:22:06 dist-test-slave-r9ct krb5kdc[15700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824926, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for HTTP/127.3.217.148@KRBTEST.COM
I20260618 23:22:06.217433 16663 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:06.218242 16679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:06.218389 16663 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:06.218461 16663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "60f0cb086406473a90b78c1cbe8c33d7"
format_stamp: "Formatted at 2026-06-18 23:22:04 on dist-test-slave-r9ct"
server_key: "f5b209daa5130cfe57bc62a9e429edac"
server_key_iv: "d547ea7ed929f3c06e1bb89c3327a51b"
server_key_version: "kuduclusterkey@0"
I20260618 23:22:06.218935 16663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:06.250809 16663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:06.252912 16663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:06.253032 16663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:06.257719 16663 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:36707
I20260618 23:22:06.257773 16731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:36707 every 8 connection(s)
I20260618 23:22:06.258140 16663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:22:06.259543 16732 sys_catalog.cc:263] Verifying existing consensus state
I20260618 23:22:06.260290 16732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7: Bootstrap starting.
I20260618 23:22:06.266870 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 16663
I20260618 23:22:06.267236 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.217.148:58023/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:46561
--local_ip_for_outbound_sockets=127.3.217.129
--tserver_master_addrs=127.3.217.190:36707
--webserver_port=36105
--webserver_interface=127.3.217.129
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:35193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.3.217.148:58023/kms with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260618 23:22:06.269243 16732 log.cc:824] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:06.271896 16732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260618 23:22:06.272262 16732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7: Bootstrap complete.
I20260618 23:22:06.275095 16732 raft_consensus.cc:348] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60f0cb086406473a90b78c1cbe8c33d7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 36707 } }
I20260618 23:22:06.275461 16732 raft_consensus.cc:729] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60f0cb086406473a90b78c1cbe8c33d7, State: Initialized, Role: FOLLOWER
I20260618 23:22:06.275660 16732 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60f0cb086406473a90b78c1cbe8c33d7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 36707 } }
I20260618 23:22:06.275741 16732 raft_consensus.cc:388] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:22:06.275794 16732 raft_consensus.cc:482] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:22:06.275844 16732 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [term 1 FOLLOWER]: Advancing to term 2
I20260618 23:22:06.277009 16732 raft_consensus.cc:504] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60f0cb086406473a90b78c1cbe8c33d7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 36707 } }
I20260618 23:22:06.277107 16732 leader_election.cc:302] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 60f0cb086406473a90b78c1cbe8c33d7; no voters:
I20260618 23:22:06.277324 16732 leader_election.cc:288] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260618 23:22:06.277360 16736 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260618 23:22:06.277462 16736 raft_consensus.cc:686] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [term 2 LEADER]: Becoming Leader. State: Replica: 60f0cb086406473a90b78c1cbe8c33d7, State: Running, Role: LEADER
I20260618 23:22:06.277624 16736 consensus_queue.cc:237] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60f0cb086406473a90b78c1cbe8c33d7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 36707 } }
I20260618 23:22:06.277624 16732 sys_catalog.cc:564] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:22:06.278015 16737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "60f0cb086406473a90b78c1cbe8c33d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60f0cb086406473a90b78c1cbe8c33d7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 36707 } } }
I20260618 23:22:06.278259 16737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [sys.catalog]: This master's current role is: LEADER
I20260618 23:22:06.278187 16738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 60f0cb086406473a90b78c1cbe8c33d7. Latest consensus state: current_term: 2 leader_uuid: "60f0cb086406473a90b78c1cbe8c33d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60f0cb086406473a90b78c1cbe8c33d7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 36707 } } }
I20260618 23:22:06.278527 16738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7 [sys.catalog]: This master's current role is: LEADER
I20260618 23:22:06.278542 16743 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:22:06.279225 16743 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:22:06.279359 16743 catalog_manager.cc:1259] Loaded cluster ID: 756e5a3414e14bb9b8cf38be6f3a5e96
I20260618 23:22:06.279386 16743 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:22:06.279623 16732 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260618 23:22:06.283849 16743 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:22:06.284519 16743 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7: Loaded TSK: 0
I20260618 23:22:06.284862 16743 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260618 23:22:06.392050 16734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:06.392388 16734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:06.392444 16734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:06.394301 16734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:06.394382 16734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:06.394438 16734 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:22:06.396620 16734 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:35193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.3.217.148:58023/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:46561
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=36105
--tserver_master_addrs=127.3.217.190:36707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:06.396982 16734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:06.397264 16734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:06.403986 16769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:06.404071 16772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:06.404001 16770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:06.404448 16734 server_base.cc:1034] running on GCE node
I20260618 23:22:06.404663 16734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:06.404946 16734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:06.406124 16734 hybrid_clock.cc:648] HybridClock initialized: now 1781824926406091 us; error 46 us; skew 500 ppm
Jun 18 23:22:06 dist-test-slave-r9ct krb5kdc[15700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824926, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:06.409322 16734 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:22:06.409853 16734 webserver.cc:460] Webserver started at http://127.3.217.129:36105/ using document root <none> and password file <none>
I20260618 23:22:06.410111 16734 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:06.410194 16734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 18 23:22:06 dist-test-slave-r9ct krb5kdc[15700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824926, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for HTTP/127.3.217.148@KRBTEST.COM
I20260618 23:22:06.443638 16734 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:06.445268 16780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:06.445448 16734 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:06.445533 16734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "0dea600f942648df80c3af814ed63551"
format_stamp: "Formatted at 2026-06-18 23:22:05 on dist-test-slave-r9ct"
server_key: "7335db6ece884cd4b8b67d1fac879eed"
server_key_iv: "56cc39824e392e9389f12d824b63d23c"
server_key_version: "kuduclusterkey@0"
I20260618 23:22:06.446018 16734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:06.460999 16734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:06.463519 16734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:06.463680 16734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:06.463928 16734 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:22:06.464244 16734 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:22:06.464308 16734 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:06.464378 16734 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:22:06.464426 16734 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:06.470973 16734 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:46561
I20260618 23:22:06.471055 16893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:46561 every 8 connection(s)
I20260618 23:22:06.471357 16734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:22:06.478910 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 16734
I20260618 23:22:06.479353 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.217.148:58023/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:45197
--local_ip_for_outbound_sockets=127.3.217.130
--tserver_master_addrs=127.3.217.190:36707
--webserver_port=46871
--webserver_interface=127.3.217.130
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:35193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.3.217.148:58023/kms with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 18 23:22:06 dist-test-slave-r9ct krb5kdc[15700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824926, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:06.485455 16896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:06.472098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:36707 (local address 127.3.217.129:36129)
0618 23:22:06.472274 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:06.472325 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:06.472989 (+ 664us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:06.473472 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:06.473477 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:06.473746 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:06.474033 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:06.474039 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:06.475331 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:06.475332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:06.476693 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:06.476707 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:06.477357 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:06.477359 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:06.477507 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:06.478443 (+ 936us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:06.478453 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:06.480293 (+ 1840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:06.483153 (+ 2860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:06.483160 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:06.483162 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:06.483500 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:06.483844 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:06.483846 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:06.483846 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:06.483991 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:06.484651 (+ 660us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:06.484658 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:06.484833 (+ 175us) client_negotiation.cc:769] Sending connection context
0618 23:22:06.484953 (+ 120us) client_negotiation.cc:240] Negotiation successful
0618 23:22:06.485155 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":96,"threads_started":1}
I20260618 23:22:06.485803 16897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:06.472266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:36129 (local address 127.3.217.190:36707)
0618 23:22:06.472490 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:06.472499 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:06.472536 (+ 37us) server_negotiation.cc:407] Connection header received
0618 23:22:06.473216 (+ 680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:06.473221 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:06.473278 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:06.473384 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:06.474219 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:06.475219 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:06.476813 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:06.477214 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:06.477329 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:06.480431 (+ 3102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:06.480435 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:06.480435 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:06.480447 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:06.482626 (+ 2179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:06.483619 (+ 993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:06.483623 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:06.483623 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:06.483750 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:06.484069 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:06.484070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:06.484070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:06.484500 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:06.484613 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:06.485440 (+ 827us) server_negotiation.cc:299] Negotiation successful
0618 23:22:06.485577 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":78,"threads_started":1}
I20260618 23:22:06.486557 16894 heartbeater.cc:347] Connected to a master server at 127.3.217.190:36707
I20260618 23:22:06.486738 16894 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:06.487063 16894 heartbeater.cc:511] Master 127.3.217.190:36707 requested a full tablet report, sending...
W20260618 23:22:06.488031 16894 heartbeater.cc:644] Failed to heartbeat to 127.3.217.190:36707 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260618 23:22:06.488147 16894 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:06.488289 16894 heartbeater.cc:511] Master 127.3.217.190:36707 requested a full tablet report, sending...
I20260618 23:22:06.488737 16894 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:06.488826 16894 heartbeater.cc:511] Master 127.3.217.190:36707 requested a full tablet report, sending...
W20260618 23:22:06.489130 16894 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260618 23:22:06.581013 16898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:06.581306 16898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:06.581347 16898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:06.583087 16898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:06.583143 16898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:06.583184 16898 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:22:06.585160 16898 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:35193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.3.217.148:58023/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:45197
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=46871
--tserver_master_addrs=127.3.217.190:36707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:06.585412 16898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:06.585701 16898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:06.591598 16906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:06.592036 16898 server_base.cc:1034] running on GCE node
W20260618 23:22:06.592353 16903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:06.595283 16904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:06.595562 16898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:06.595885 16898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:06.597079 16898 hybrid_clock.cc:648] HybridClock initialized: now 1781824926597051 us; error 42 us; skew 500 ppm
Jun 18 23:22:06 dist-test-slave-r9ct krb5kdc[15700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824926, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:06.603847 16898 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:22:06.604449 16898 webserver.cc:460] Webserver started at http://127.3.217.130:46871/ using document root <none> and password file <none>
I20260618 23:22:06.604816 16898 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:06.604967 16898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 18 23:22:06 dist-test-slave-r9ct krb5kdc[15700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824926, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for HTTP/127.3.217.148@KRBTEST.COM
I20260618 23:22:06.622221 16898 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:06.623342 16914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:06.623534 16898 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:06.623623 16898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "6c027df0f6c94d4e97f428bf8c0b6d40"
format_stamp: "Formatted at 2026-06-18 23:22:05 on dist-test-slave-r9ct"
server_key: "d83787c80a830469e3c68e5629d6de1b"
server_key_iv: "a1e82843578e23b23713a8516c6ca5ec"
server_key_version: "kuduclusterkey@0"
I20260618 23:22:06.624001 16898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:06.639976 16898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:06.642084 16898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:06.642252 16898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:06.642513 16898 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:22:06.642905 16898 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:22:06.642951 16898 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:06.643028 16898 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:22:06.643062 16898 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:06.650837 16898 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:45197
I20260618 23:22:06.650923 17027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:45197 every 8 connection(s)
I20260618 23:22:06.651301 16898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:22:06.651515 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 16898
I20260618 23:22:06.651803 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.217.148:58023/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:41157
--local_ip_for_outbound_sockets=127.3.217.131
--tserver_master_addrs=127.3.217.190:36707
--webserver_port=42897
--webserver_interface=127.3.217.131
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:35193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.3.217.148:58023/kms with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 18 23:22:06 dist-test-slave-r9ct krb5kdc[15700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824926, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:06.677837 16897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:06.656095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:43363 (local address 127.3.217.190:36707)
0618 23:22:06.656177 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:06.656180 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:06.659113 (+ 2933us) server_negotiation.cc:407] Connection header received
0618 23:22:06.659917 (+ 804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:06.659920 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:06.659942 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:06.660020 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:06.660992 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:06.661734 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:06.662770 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:06.662967 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:06.663061 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:06.674414 (+ 11353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:06.674415 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:06.674416 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:06.674425 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:06.676248 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:06.676703 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:06.676703 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:06.676704 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:06.676762 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:06.677023 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:06.677024 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:06.677024 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:06.677206 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:06.677287 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:06.677646 (+ 359us) server_negotiation.cc:299] Negotiation successful
0618 23:22:06.677733 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260618 23:22:06.677999 17031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:06.655356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:36707 (local address 127.3.217.130:43363)
0618 23:22:06.658919 (+ 3563us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:06.658977 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:06.659561 (+ 584us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:06.660225 (+ 664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:06.660231 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:06.660549 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:06.660840 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:06.660846 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:06.661841 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:06.661842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:06.662626 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:06.662628 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:06.663093 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:06.663094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:06.663227 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:06.663790 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:06.663799 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:06.674252 (+ 10453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:06.676344 (+ 2092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:06.676353 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:06.676355 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:06.676610 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:06.676836 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:06.676837 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:06.676837 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:06.676949 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:06.677286 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:06.677293 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:06.677464 (+ 171us) client_negotiation.cc:769] Sending connection context
0618 23:22:06.677595 (+ 131us) client_negotiation.cc:240] Negotiation successful
0618 23:22:06.677755 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3499,"thread_start_us":154,"threads_started":1}
I20260618 23:22:06.678601 17028 heartbeater.cc:347] Connected to a master server at 127.3.217.190:36707
I20260618 23:22:06.678699 17028 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:06.678920 17028 heartbeater.cc:511] Master 127.3.217.190:36707 requested a full tablet report, sending...
W20260618 23:22:06.679734 17028 heartbeater.cc:644] Failed to heartbeat to 127.3.217.190:36707 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260618 23:22:06.679809 17028 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:06.679870 17028 heartbeater.cc:511] Master 127.3.217.190:36707 requested a full tablet report, sending...
I20260618 23:22:06.680197 17028 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:06.680368 17028 heartbeater.cc:511] Master 127.3.217.190:36707 requested a full tablet report, sending...
W20260618 23:22:06.680749 17028 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260618 23:22:06.783439 17030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:06.783736 17030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:06.783775 17030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:06.785693 17030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:06.785768 17030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:06.785815 17030 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:22:06.788232 17030 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:35193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.3.217.148:58023/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:41157
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=42897
--tserver_master_addrs=127.3.217.190:36707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17030
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:06.788517 17030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:06.788892 17030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:06.794588 17039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:06.794772 17037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:06.795010 17036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:06.795164 17030 server_base.cc:1034] running on GCE node
I20260618 23:22:06.795388 17030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:06.795706 17030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:06.796900 17030 hybrid_clock.cc:648] HybridClock initialized: now 1781824926796881 us; error 59 us; skew 500 ppm
Jun 18 23:22:06 dist-test-slave-r9ct krb5kdc[15700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824926, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:06.800429 17030 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:22:06.801046 17030 webserver.cc:460] Webserver started at http://127.3.217.131:42897/ using document root <none> and password file <none>
I20260618 23:22:06.801359 17030 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:06.801457 17030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 18 23:22:06 dist-test-slave-r9ct krb5kdc[15700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824926, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for HTTP/127.3.217.148@KRBTEST.COM
I20260618 23:22:06.826754 17030 fs_manager.cc:709] Time spent opening directory manager: real 0.009s user 0.001s sys 0.000s
I20260618 23:22:06.828171 17047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:06.828402 17030 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:06.828496 17030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "b852e988ef3e4996ab700ef1ee479ea9"
format_stamp: "Formatted at 2026-06-18 23:22:05 on dist-test-slave-r9ct"
server_key: "fa14a8ee81e4fa4490aca69fcd6a26fe"
server_key_iv: "d8332cfca1fccc42e1b95bcb63928cc1"
server_key_version: "kuduclusterkey@0"
I20260618 23:22:06.828902 17030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:06.855454 17030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:06.858002 17030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:06.858155 17030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:06.858443 17030 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:22:06.858819 17030 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:22:06.858862 17030 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:06.858894 17030 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:22:06.858920 17030 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:06.866407 17030 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:41157
I20260618 23:22:06.866693 17161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:41157 every 8 connection(s)
I20260618 23:22:06.866984 17030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:22:06.871276 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 17030
Jun 18 23:22:06 dist-test-slave-r9ct krb5kdc[15700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824926, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:06.879070 16897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:06.868366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:39241 (local address 127.3.217.190:36707)
0618 23:22:06.868426 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:06.868429 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:06.868442 (+ 13us) server_negotiation.cc:407] Connection header received
0618 23:22:06.868956 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:06.868957 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:06.868970 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:06.869044 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:06.869652 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:06.870392 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:06.872119 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:06.872472 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:06.872556 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:06.875275 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:06.875276 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:06.875277 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:06.875285 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:06.877291 (+ 2006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:06.877862 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:06.877863 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:06.877863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:06.877928 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:06.878251 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:06.878252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:06.878252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:06.878398 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:06.878470 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:06.878886 (+ 416us) server_negotiation.cc:299] Negotiation successful
0618 23:22:06.878976 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260618 23:22:06.879349 17164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:06.868023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:36707 (local address 127.3.217.131:39241)
0618 23:22:06.868249 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:06.868315 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:06.868844 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:06.869116 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:06.869120 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:06.869348 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:06.869550 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:06.869554 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:06.870508 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:06.870509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:06.872021 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:06.872024 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:06.872594 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:06.872596 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:06.872748 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:06.873387 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:06.873397 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:06.875169 (+ 1772us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:06.877406 (+ 2237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:06.877413 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:06.877416 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:06.877764 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:06.878013 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:06.878014 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:06.878014 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:06.878156 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:06.878501 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:06.878507 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:06.878694 (+ 187us) client_negotiation.cc:769] Sending connection context
0618 23:22:06.878862 (+ 168us) client_negotiation.cc:240] Negotiation successful
0618 23:22:06.879043 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":92,"threads_started":1}
I20260618 23:22:06.879846 17162 heartbeater.cc:347] Connected to a master server at 127.3.217.190:36707
I20260618 23:22:06.879952 17162 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:06.880142 17162 heartbeater.cc:511] Master 127.3.217.190:36707 requested a full tablet report, sending...
W20260618 23:22:06.880764 17162 heartbeater.cc:644] Failed to heartbeat to 127.3.217.190:36707 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260618 23:22:06.880853 17162 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:06.880923 17162 heartbeater.cc:511] Master 127.3.217.190:36707 requested a full tablet report, sending...
I20260618 23:22:06.881214 17162 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:06.881295 17162 heartbeater.cc:511] Master 127.3.217.190:36707 requested a full tablet report, sending...
W20260618 23:22:06.881636 17162 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260618 23:22:06.882591 17166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:06.871710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43912 (local address 127.3.217.190:36707)
0618 23:22:06.872147 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:06.872149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:06.872157 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:22:06.872177 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:06.872178 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:06.872190 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:06.872257 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:06.874062 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:06.874854 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:06.876484 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:06.876738 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:06.876840 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:06.879572 (+ 2732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:06.879573 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:06.879574 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:06.879581 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:06.881477 (+ 1896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:06.881827 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:06.881828 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:06.881828 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:06.881882 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:06.882102 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:06.882103 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:06.882103 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:06.882207 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:06.882376 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:06.882412 (+ 36us) server_negotiation.cc:299] Negotiation successful
0618 23:22:06.882491 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":110,"threads_started":1}
Jun 18 23:22:07 dist-test-slave-r9ct krb5kdc[15700](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781824927, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:07.489328 16894 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:07.489462 16894 heartbeater.cc:511] Master 127.3.217.190:36707 requested a full tablet report, sending...
I20260618 23:22:07.489811 16696 ts_manager.cc:194] Registered new tserver with Master: 0dea600f942648df80c3af814ed63551 (127.3.217.129:46561)
I20260618 23:22:07.490813 16696 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:36129
I20260618 23:22:07.680974 17028 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:07.681130 17028 heartbeater.cc:511] Master 127.3.217.190:36707 requested a full tablet report, sending...
I20260618 23:22:07.681571 16696 ts_manager.cc:194] Registered new tserver with Master: 6c027df0f6c94d4e97f428bf8c0b6d40 (127.3.217.130:45197)
I20260618 23:22:07.682111 16696 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:43363
Jun 18 23:22:07 dist-test-slave-r9ct krb5kdc[15700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824927, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for HTTP/127.3.217.148@KRBTEST.COM
I20260618 23:22:07.886837 17162 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:07.886992 17162 heartbeater.cc:511] Master 127.3.217.190:36707 requested a full tablet report, sending...
I20260618 23:22:07.887277 16696 ts_manager.cc:194] Registered new tserver with Master: b852e988ef3e4996ab700ef1ee479ea9 (127.3.217.131:41157)
I20260618 23:22:07.887812 16696 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:39241
I20260618 23:22:07.889835 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260618 23:22:07.910356 17183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:07.891012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43922 (local address 127.3.217.190:36707)
0618 23:22:07.892532 (+ 1520us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:07.892534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:07.895014 (+ 2480us) server_negotiation.cc:407] Connection header received
0618 23:22:07.900501 (+ 5487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:07.900503 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:07.900521 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:07.900574 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:07.903415 (+ 2841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:07.904212 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:07.905286 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:07.905591 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:07.905651 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:07.907171 (+ 1520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:07.907172 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:07.907173 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:07.907179 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:07.908936 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:07.909312 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:07.909313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:07.909314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:07.909372 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:07.909562 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:07.909562 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:07.909563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:07.909684 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:07.909768 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:07.910172 (+ 404us) server_negotiation.cc:299] Negotiation successful
0618 23:22:07.910250 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1496,"thread_start_us":61,"threads_started":1}
I20260618 23:22:07.912729 16696 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43922:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:22:07.915060 16696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:22:07.929585 17191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:07.923505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:41157 (local address 127.0.0.1:46802)
0618 23:22:07.924655 (+ 1150us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:07.924665 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:07.924721 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:07.925010 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:07.925013 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:07.925015 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:07.925104 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:07.925105 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:07.926548 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:07.926550 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:07.928092 (+ 1542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:07.928095 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:07.929243 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:07.929244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:07.929340 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:07.929353 (+ 13us) client_negotiation.cc:769] Sending connection context
0618 23:22:07.929430 (+ 77us) client_negotiation.cc:240] Negotiation successful
0618 23:22:07.929486 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1133,"thread_start_us":65,"threads_started":1}
I20260618 23:22:07.930084 17193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:07.923909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46802 (local address 127.3.217.131:41157)
0618 23:22:07.924523 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:07.924528 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:07.924785 (+ 257us) server_negotiation.cc:407] Connection header received
0618 23:22:07.924826 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:07.924828 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:07.924845 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:07.924918 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:07.925191 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:07.926441 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:07.928198 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:07.929039 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:07.929135 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:07.929199 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:07.929944 (+ 745us) server_negotiation.cc:299] Negotiation successful
0618 23:22:07.929991 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":56,"threads_started":1}
I20260618 23:22:07.931138 17096 tablet_service.cc:1467] Processing CreateTablet for tablet d3f2895029834c429582ebaaf8b66d9f (DEFAULT_TABLE table=test-table [id=b48c8b819eb541c39521d872ecc380c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:22:07.931526 17096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3f2895029834c429582ebaaf8b66d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:07.942181 17191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:07.923654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:45197 (local address 127.0.0.1:34746)
0618 23:22:07.935792 (+ 12138us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:07.935805 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:07.935896 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:07.936211 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:07.936212 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:07.936213 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:07.936251 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:07.936252 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:07.937605 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:07.937605 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:07.938865 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:07.938868 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:07.941905 (+ 3037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:07.941906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:07.941976 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:07.941978 (+ 2us) client_negotiation.cc:769] Sending connection context
0618 23:22:07.942029 (+ 51us) client_negotiation.cc:240] Negotiation successful
0618 23:22:07.942089 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12126,"thread_start_us":55,"threads_started":1}
I20260618 23:22:07.942603 17194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:07.924043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34746 (local address 127.3.217.130:45197)
0618 23:22:07.924602 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:07.924606 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:07.935862 (+ 11256us) server_negotiation.cc:407] Connection header received
0618 23:22:07.935998 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:07.936002 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:07.936021 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:07.936094 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:07.936328 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:07.937494 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:07.940772 (+ 3278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:07.941720 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:07.941775 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:07.941836 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:07.942471 (+ 635us) server_negotiation.cc:299] Negotiation successful
0618 23:22:07.942522 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":79,"threads_started":1}
I20260618 23:22:07.943567 16962 tablet_service.cc:1467] Processing CreateTablet for tablet d3f2895029834c429582ebaaf8b66d9f (DEFAULT_TABLE table=test-table [id=b48c8b819eb541c39521d872ecc380c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:22:07.943940 16962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3f2895029834c429582ebaaf8b66d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:07.950947 17192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:07.923283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:46561 (local address 127.0.0.1:42434)
0618 23:22:07.924259 (+ 976us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:07.924304 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:07.924375 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:07.939300 (+ 14925us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:07.939301 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:07.939304 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:07.939365 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:07.939367 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:07.948196 (+ 8829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:07.948197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:07.949481 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:07.949485 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:07.950640 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:07.950641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:07.950760 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:07.950766 (+ 6us) client_negotiation.cc:769] Sending connection context
0618 23:22:07.950806 (+ 40us) client_negotiation.cc:240] Negotiation successful
0618 23:22:07.950856 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":944,"thread_start_us":78,"threads_started":1}
I20260618 23:22:07.951594 17190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:07.923379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42434 (local address 127.3.217.129:46561)
0618 23:22:07.939084 (+ 15705us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:07.939090 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:07.939108 (+ 18us) server_negotiation.cc:407] Connection header received
0618 23:22:07.939149 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:07.939152 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:07.939169 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:07.939446 (+ 277us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:07.939532 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:07.940645 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:07.949611 (+ 8966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:07.950516 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:07.951350 (+ 834us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:07.951428 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:07.951459 (+ 31us) server_negotiation.cc:299] Negotiation successful
0618 23:22:07.951507 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15651,"thread_start_us":54,"threads_started":1}
I20260618 23:22:07.951992 17195 tablet_bootstrap.cc:492] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9: Bootstrap starting.
I20260618 23:22:07.952472 16828 tablet_service.cc:1467] Processing CreateTablet for tablet d3f2895029834c429582ebaaf8b66d9f (DEFAULT_TABLE table=test-table [id=b48c8b819eb541c39521d872ecc380c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:22:07.952854 16828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3f2895029834c429582ebaaf8b66d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:07.952879 17195 tablet_bootstrap.cc:654] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9: Neither blocks nor log segments found. Creating new log.
I20260618 23:22:07.953325 17195 log.cc:824] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:07.953742 17196 tablet_bootstrap.cc:492] T d3f2895029834c429582ebaaf8b66d9f P 6c027df0f6c94d4e97f428bf8c0b6d40: Bootstrap starting.
I20260618 23:22:07.954489 17196 tablet_bootstrap.cc:654] T d3f2895029834c429582ebaaf8b66d9f P 6c027df0f6c94d4e97f428bf8c0b6d40: Neither blocks nor log segments found. Creating new log.
I20260618 23:22:07.954924 17196 log.cc:824] T d3f2895029834c429582ebaaf8b66d9f P 6c027df0f6c94d4e97f428bf8c0b6d40: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:07.955807 17195 tablet_bootstrap.cc:492] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9: No bootstrap required, opened a new log
I20260618 23:22:07.955932 17195 ts_tablet_manager.cc:1397] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260618 23:22:07.959347 17195 raft_consensus.cc:348] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dea600f942648df80c3af814ed63551" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 46561 } } peers { permanent_uuid: "b852e988ef3e4996ab700ef1ee479ea9" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41157 } } peers { permanent_uuid: "6c027df0f6c94d4e97f428bf8c0b6d40" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 45197 } }
I20260618 23:22:07.959830 17195 raft_consensus.cc:374] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:22:07.959940 17195 raft_consensus.cc:729] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b852e988ef3e4996ab700ef1ee479ea9, State: Initialized, Role: FOLLOWER
I20260618 23:22:07.960192 17195 consensus_queue.cc:260] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dea600f942648df80c3af814ed63551" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 46561 } } peers { permanent_uuid: "b852e988ef3e4996ab700ef1ee479ea9" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41157 } } peers { permanent_uuid: "6c027df0f6c94d4e97f428bf8c0b6d40" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 45197 } }
I20260618 23:22:07.960843 17195 ts_tablet_manager.cc:1428] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260618 23:22:07.961043 17162 heartbeater.cc:503] Master 127.3.217.190:36707 was elected leader, sending a full tablet report...
I20260618 23:22:07.962615 17196 tablet_bootstrap.cc:492] T d3f2895029834c429582ebaaf8b66d9f P 6c027df0f6c94d4e97f428bf8c0b6d40: No bootstrap required, opened a new log
I20260618 23:22:07.962775 17196 ts_tablet_manager.cc:1397] T d3f2895029834c429582ebaaf8b66d9f P 6c027df0f6c94d4e97f428bf8c0b6d40: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20260618 23:22:07.965261 17196 raft_consensus.cc:348] T d3f2895029834c429582ebaaf8b66d9f P 6c027df0f6c94d4e97f428bf8c0b6d40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dea600f942648df80c3af814ed63551" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 46561 } } peers { permanent_uuid: "b852e988ef3e4996ab700ef1ee479ea9" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41157 } } peers { permanent_uuid: "6c027df0f6c94d4e97f428bf8c0b6d40" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 45197 } }
I20260618 23:22:07.965502 17196 raft_consensus.cc:374] T d3f2895029834c429582ebaaf8b66d9f P 6c027df0f6c94d4e97f428bf8c0b6d40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:22:07.965574 17196 raft_consensus.cc:729] T d3f2895029834c429582ebaaf8b66d9f P 6c027df0f6c94d4e97f428bf8c0b6d40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c027df0f6c94d4e97f428bf8c0b6d40, State: Initialized, Role: FOLLOWER
I20260618 23:22:07.965886 17196 consensus_queue.cc:260] T d3f2895029834c429582ebaaf8b66d9f P 6c027df0f6c94d4e97f428bf8c0b6d40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dea600f942648df80c3af814ed63551" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 46561 } } peers { permanent_uuid: "b852e988ef3e4996ab700ef1ee479ea9" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41157 } } peers { permanent_uuid: "6c027df0f6c94d4e97f428bf8c0b6d40" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 45197 } }
I20260618 23:22:07.966259 17196 ts_tablet_manager.cc:1428] T d3f2895029834c429582ebaaf8b66d9f P 6c027df0f6c94d4e97f428bf8c0b6d40: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260618 23:22:07.966404 17028 heartbeater.cc:503] Master 127.3.217.190:36707 was elected leader, sending a full tablet report...
I20260618 23:22:07.967608 17199 tablet_bootstrap.cc:492] T d3f2895029834c429582ebaaf8b66d9f P 0dea600f942648df80c3af814ed63551: Bootstrap starting.
I20260618 23:22:07.968313 17199 tablet_bootstrap.cc:654] T d3f2895029834c429582ebaaf8b66d9f P 0dea600f942648df80c3af814ed63551: Neither blocks nor log segments found. Creating new log.
I20260618 23:22:07.968863 17199 log.cc:824] T d3f2895029834c429582ebaaf8b66d9f P 0dea600f942648df80c3af814ed63551: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:07.969606 17199 tablet_bootstrap.cc:492] T d3f2895029834c429582ebaaf8b66d9f P 0dea600f942648df80c3af814ed63551: No bootstrap required, opened a new log
I20260618 23:22:07.969666 17199 ts_tablet_manager.cc:1397] T d3f2895029834c429582ebaaf8b66d9f P 0dea600f942648df80c3af814ed63551: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:22:07.971665 17199 raft_consensus.cc:348] T d3f2895029834c429582ebaaf8b66d9f P 0dea600f942648df80c3af814ed63551 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dea600f942648df80c3af814ed63551" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 46561 } } peers { permanent_uuid: "b852e988ef3e4996ab700ef1ee479ea9" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41157 } } peers { permanent_uuid: "6c027df0f6c94d4e97f428bf8c0b6d40" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 45197 } }
I20260618 23:22:07.971807 17199 raft_consensus.cc:374] T d3f2895029834c429582ebaaf8b66d9f P 0dea600f942648df80c3af814ed63551 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:22:07.971835 17199 raft_consensus.cc:729] T d3f2895029834c429582ebaaf8b66d9f P 0dea600f942648df80c3af814ed63551 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dea600f942648df80c3af814ed63551, State: Initialized, Role: FOLLOWER
I20260618 23:22:07.971943 17199 consensus_queue.cc:260] T d3f2895029834c429582ebaaf8b66d9f P 0dea600f942648df80c3af814ed63551 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dea600f942648df80c3af814ed63551" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 46561 } } peers { permanent_uuid: "b852e988ef3e4996ab700ef1ee479ea9" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41157 } } peers { permanent_uuid: "6c027df0f6c94d4e97f428bf8c0b6d40" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 45197 } }
I20260618 23:22:07.972163 17199 ts_tablet_manager.cc:1428] T d3f2895029834c429582ebaaf8b66d9f P 0dea600f942648df80c3af814ed63551: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:22:07.972306 16894 heartbeater.cc:503] Master 127.3.217.190:36707 was elected leader, sending a full tablet report...
W20260618 23:22:07.972823 16895 tablet.cc:2369] T d3f2895029834c429582ebaaf8b66d9f P 0dea600f942648df80c3af814ed63551: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 23:22:08.024493 17200 raft_consensus.cc:482] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:22:08.024655 17200 raft_consensus.cc:504] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dea600f942648df80c3af814ed63551" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 46561 } } peers { permanent_uuid: "b852e988ef3e4996ab700ef1ee479ea9" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41157 } } peers { permanent_uuid: "6c027df0f6c94d4e97f428bf8c0b6d40" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 45197 } }
I20260618 23:22:08.025069 17200 leader_election.cc:288] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0dea600f942648df80c3af814ed63551 (127.3.217.129:46561), 6c027df0f6c94d4e97f428bf8c0b6d40 (127.3.217.130:45197)
I20260618 23:22:08.029838 17190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:08.025772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:43699 (local address 127.3.217.129:46561)
0618 23:22:08.025870 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:08.025872 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:08.026036 (+ 164us) server_negotiation.cc:407] Connection header received
0618 23:22:08.026158 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:08.026159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:08.026169 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:08.026199 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:08.026454 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:08.027249 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:08.028808 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:08.029402 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:08.029460 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:08.029471 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:08.029718 (+ 247us) server_negotiation.cc:299] Negotiation successful
0618 23:22:08.029765 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260618 23:22:08.030121 17205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:08.025333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:46561 (local address 127.3.217.131:43699)
0618 23:22:08.025961 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:08.025973 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:08.026076 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:08.026273 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:08.026274 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:08.026276 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:08.026364 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:08.026366 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:08.027416 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:08.027417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:08.028701 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:08.028704 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:08.029551 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:08.029552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:08.029623 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:08.029627 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:22:08.029978 (+ 351us) client_negotiation.cc:240] Negotiation successful
0618 23:22:08.030021 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":98,"threads_started":1}
I20260618 23:22:08.030495 16848 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3f2895029834c429582ebaaf8b66d9f" candidate_uuid: "b852e988ef3e4996ab700ef1ee479ea9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dea600f942648df80c3af814ed63551" is_pre_election: true
I20260618 23:22:08.030691 16848 raft_consensus.cc:2454] T d3f2895029834c429582ebaaf8b66d9f P 0dea600f942648df80c3af814ed63551 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b852e988ef3e4996ab700ef1ee479ea9 in term 0.
I20260618 23:22:08.030983 17050 leader_election.cc:302] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dea600f942648df80c3af814ed63551, b852e988ef3e4996ab700ef1ee479ea9; no voters:
I20260618 23:22:08.031133 17200 raft_consensus.cc:2781] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:22:08.031183 17200 raft_consensus.cc:482] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:22:08.031211 17200 raft_consensus.cc:3037] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:22:08.032198 17200 raft_consensus.cc:504] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dea600f942648df80c3af814ed63551" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 46561 } } peers { permanent_uuid: "b852e988ef3e4996ab700ef1ee479ea9" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41157 } } peers { permanent_uuid: "6c027df0f6c94d4e97f428bf8c0b6d40" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 45197 } }
I20260618 23:22:08.032347 17200 leader_election.cc:288] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9 [CANDIDATE]: Term 1 election: Requested vote from peers 0dea600f942648df80c3af814ed63551 (127.3.217.129:46561), 6c027df0f6c94d4e97f428bf8c0b6d40 (127.3.217.130:45197)
I20260618 23:22:08.032548 16848 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3f2895029834c429582ebaaf8b66d9f" candidate_uuid: "b852e988ef3e4996ab700ef1ee479ea9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dea600f942648df80c3af814ed63551"
I20260618 23:22:08.032632 16848 raft_consensus.cc:3037] T d3f2895029834c429582ebaaf8b66d9f P 0dea600f942648df80c3af814ed63551 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:22:08.033491 16848 raft_consensus.cc:2454] T d3f2895029834c429582ebaaf8b66d9f P 0dea600f942648df80c3af814ed63551 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b852e988ef3e4996ab700ef1ee479ea9 in term 1.
I20260618 23:22:08.033675 17050 leader_election.cc:302] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dea600f942648df80c3af814ed63551, b852e988ef3e4996ab700ef1ee479ea9; no voters:
I20260618 23:22:08.033764 17200 raft_consensus.cc:2781] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:22:08.033758 17194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:08.025820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:55439 (local address 127.3.217.130:45197)
0618 23:22:08.025903 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:08.025905 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:08.030403 (+ 4498us) server_negotiation.cc:407] Connection header received
0618 23:22:08.030506 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:08.030507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:08.030518 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:08.030547 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:08.030733 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:08.031460 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:08.032822 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:08.033386 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:08.033437 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:08.033445 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:08.033642 (+ 197us) server_negotiation.cc:299] Negotiation successful
0618 23:22:08.033684 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260618 23:22:08.033902 17200 raft_consensus.cc:686] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9 [term 1 LEADER]: Becoming Leader. State: Replica: b852e988ef3e4996ab700ef1ee479ea9, State: Running, Role: LEADER
I20260618 23:22:08.033993 17205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:08.025543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:45197 (local address 127.3.217.131:55439)
0618 23:22:08.030352 (+ 4809us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:08.030363 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:08.030429 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:08.030610 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:08.030611 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:08.030612 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:08.030643 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:08.030645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:08.031586 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:08.031587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:08.032722 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:08.032725 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:08.033503 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:08.033504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:08.033562 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:08.033565 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:22:08.033880 (+ 315us) client_negotiation.cc:240] Negotiation successful
0618 23:22:08.033920 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4797,"thread_start_us":65,"threads_started":1}
I20260618 23:22:08.033993 17200 consensus_queue.cc:237] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dea600f942648df80c3af814ed63551" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 46561 } } peers { permanent_uuid: "b852e988ef3e4996ab700ef1ee479ea9" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41157 } } peers { permanent_uuid: "6c027df0f6c94d4e97f428bf8c0b6d40" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 45197 } }
I20260618 23:22:08.034361 16982 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3f2895029834c429582ebaaf8b66d9f" candidate_uuid: "b852e988ef3e4996ab700ef1ee479ea9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c027df0f6c94d4e97f428bf8c0b6d40" is_pre_election: true
I20260618 23:22:08.034533 16982 raft_consensus.cc:2454] T d3f2895029834c429582ebaaf8b66d9f P 6c027df0f6c94d4e97f428bf8c0b6d40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b852e988ef3e4996ab700ef1ee479ea9 in term 0.
I20260618 23:22:08.034677 16981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3f2895029834c429582ebaaf8b66d9f" candidate_uuid: "b852e988ef3e4996ab700ef1ee479ea9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c027df0f6c94d4e97f428bf8c0b6d40"
I20260618 23:22:08.034770 16981 raft_consensus.cc:3037] T d3f2895029834c429582ebaaf8b66d9f P 6c027df0f6c94d4e97f428bf8c0b6d40 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:22:08.035128 16695 catalog_manager.cc:5495] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b852e988ef3e4996ab700ef1ee479ea9 (127.3.217.131). New cstate: current_term: 1 leader_uuid: "b852e988ef3e4996ab700ef1ee479ea9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dea600f942648df80c3af814ed63551" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 46561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b852e988ef3e4996ab700ef1ee479ea9" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c027df0f6c94d4e97f428bf8c0b6d40" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 45197 } health_report { overall_health: UNKNOWN } } }
I20260618 23:22:08.035626 16981 raft_consensus.cc:2454] T d3f2895029834c429582ebaaf8b66d9f P 6c027df0f6c94d4e97f428bf8c0b6d40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b852e988ef3e4996ab700ef1ee479ea9 in term 1.
I20260618 23:22:08.041705 17193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:08.038470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46810 (local address 127.3.217.131:41157)
0618 23:22:08.038512 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:08.038514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:08.038526 (+ 12us) server_negotiation.cc:407] Connection header received
0618 23:22:08.038564 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:08.038565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:08.038579 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:08.038673 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:22:08.038828 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:08.039493 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:08.040584 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:08.040881 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:08.040951 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:08.041156 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:22:08.041277 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:22:08.041379 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:08.041608 (+ 229us) server_negotiation.cc:299] Negotiation successful
0618 23:22:08.041634 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260618 23:22:08.043710 16981 raft_consensus.cc:1261] T d3f2895029834c429582ebaaf8b66d9f P 6c027df0f6c94d4e97f428bf8c0b6d40 [term 1 FOLLOWER]: Refusing update from remote peer b852e988ef3e4996ab700ef1ee479ea9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:22:08.044049 17206 consensus_queue.cc:1035] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c027df0f6c94d4e97f428bf8c0b6d40" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 45197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:22:08.047061 16848 raft_consensus.cc:1261] T d3f2895029834c429582ebaaf8b66d9f P 0dea600f942648df80c3af814ed63551 [term 1 FOLLOWER]: Refusing update from remote peer b852e988ef3e4996ab700ef1ee479ea9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:22:08.047333 17206 consensus_queue.cc:1035] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dea600f942648df80c3af814ed63551" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 46561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:22:08.050910 17209 mvcc.cc:205] Tried to move back new op lower bound from 7298354905263865856 to 7298354905228873728. Current Snapshot: MvccSnapshot[applied={T|T < 7298354905263865856}]
I20260618 23:22:08.051023 17210 mvcc.cc:205] Tried to move back new op lower bound from 7298354905263865856 to 7298354905228873728. Current Snapshot: MvccSnapshot[applied={T|T < 7298354905263865856}]
I20260618 23:22:08.053644 16695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43922:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:22:08.053751 16695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43922:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:22:08.054409 16695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 60f0cb086406473a90b78c1cbe8c33d7: Sending DeleteTablet for 3 replicas of tablet d3f2895029834c429582ebaaf8b66d9f
I20260618 23:22:08.054962 16828 tablet_service.cc:1514] Processing DeleteTablet for tablet d3f2895029834c429582ebaaf8b66d9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:22:08 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:42434
I20260618 23:22:08.055156 17096 tablet_service.cc:1514] Processing DeleteTablet for tablet d3f2895029834c429582ebaaf8b66d9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:22:08 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:46802
I20260618 23:22:08.055346 16962 tablet_service.cc:1514] Processing DeleteTablet for tablet d3f2895029834c429582ebaaf8b66d9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:22:08 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:34746
I20260618 23:22:08.055930 17212 mvcc.cc:205] Tried to move back new op lower bound from 7298354905263865856 to 7298354905228873728. Current Snapshot: MvccSnapshot[applied={T|T < 7298354905263865856}]
I20260618 23:22:08.056212 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 16734
I20260618 23:22:08.062911 17218 tablet_replica.cc:330] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9: stopping tablet replica
I20260618 23:22:08.063019 17218 raft_consensus.cc:2229] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9 [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:22:08.063109 17218 raft_consensus.cc:2258] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:22:08.063285 17219 tablet_replica.cc:330] T d3f2895029834c429582ebaaf8b66d9f P 6c027df0f6c94d4e97f428bf8c0b6d40: stopping tablet replica
I20260618 23:22:08.063376 17219 raft_consensus.cc:2229] T d3f2895029834c429582ebaaf8b66d9f P 6c027df0f6c94d4e97f428bf8c0b6d40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:22:08.063468 17219 raft_consensus.cc:2258] T d3f2895029834c429582ebaaf8b66d9f P 6c027df0f6c94d4e97f428bf8c0b6d40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:22:08.063930 17219 ts_tablet_manager.cc:1905] T d3f2895029834c429582ebaaf8b66d9f P 6c027df0f6c94d4e97f428bf8c0b6d40: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:22:08.065537 17219 ts_tablet_manager.cc:1918] T d3f2895029834c429582ebaaf8b66d9f P 6c027df0f6c94d4e97f428bf8c0b6d40: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:22:08.065665 17219 log.cc:1196] T d3f2895029834c429582ebaaf8b66d9f P 6c027df0f6c94d4e97f428bf8c0b6d40: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/d3f2895029834c429582ebaaf8b66d9f
I20260618 23:22:08.065994 17219 ts_tablet_manager.cc:1939] T d3f2895029834c429582ebaaf8b66d9f P 6c027df0f6c94d4e97f428bf8c0b6d40: Deleting consensus metadata
I20260618 23:22:08.066463 16682 catalog_manager.cc:4841] TS 6c027df0f6c94d4e97f428bf8c0b6d40 (127.3.217.130:45197): tablet d3f2895029834c429582ebaaf8b66d9f (table test-table [id=b48c8b819eb541c39521d872ecc380c1]) successfully deleted
I20260618 23:22:08.066838 17218 ts_tablet_manager.cc:1905] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260618 23:22:08.074128 16681 connection.cc:535] server connection from 127.3.217.129:36129 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260618 23:22:08.074348 16682 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.217.129:46561 (error 108)
I20260618 23:22:08.075011 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 16898
I20260618 23:22:08.077096 17218 ts_tablet_manager.cc:1918] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:22:08.077181 17218 log.cc:1196] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/d3f2895029834c429582ebaaf8b66d9f
I20260618 23:22:08.077502 17218 ts_tablet_manager.cc:1939] T d3f2895029834c429582ebaaf8b66d9f P b852e988ef3e4996ab700ef1ee479ea9: Deleting consensus metadata
I20260618 23:22:08.077945 16682 catalog_manager.cc:4841] TS b852e988ef3e4996ab700ef1ee479ea9 (127.3.217.131:41157): tablet d3f2895029834c429582ebaaf8b66d9f (table test-table [id=b48c8b819eb541c39521d872ecc380c1]) successfully deleted
I20260618 23:22:08.081409 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 17030
I20260618 23:22:08.083032 17192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:08.082908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:46561 (local address 127.0.0.1:42440)
0618 23:22:08.082961 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:08.082996 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.129:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260618 23:22:08.084004 16682 catalog_manager.cc:4584] TS 0dea600f942648df80c3af814ed63551 (127.3.217.129:46561): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d3f2895029834c429582ebaaf8b66d9f: Network error: Client connection negotiation failed: client connection to 127.3.217.129:46561: connect: Connection refused (error 111)
I20260618 23:22:08.087316 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 16663
I20260618 23:22:08.093976 3942 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260618 23:22:08.438704 3942 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260618 23:22:08.438892 3942 mini_ranger.cc:66] Stopping Ranger...
I20260618 23:22:08.783669 3942 mini_ranger.cc:68] Stopped Ranger
2026-06-18 23:22:08.783 UTC [15730] LOG: received smart shutdown request
2026-06-18 23:22:08.787 UTC [15730] LOG: background worker "logical replication launcher" (PID 15739) exited with exit code 1
2026-06-18 23:22:08.787 UTC [15734] LOG: shutting down
2026-06-18 23:22:08.995 UTC [15730] LOG: database system is shut down
2026-06-18T23:22:08Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (50973 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:22:09 dist-test-slave-r9ct krb5kdc[17230](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:22:09 dist-test-slave-r9ct krb5kdc[17230](info): set up 2 sockets
Jun 18 23:22:09 dist-test-slave-r9ct krb5kdc[17230](info): commencing operation
krb5kdc: starting...
W20260618 23:22:10.190855 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.068s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:22:10 dist-test-slave-r9ct krb5kdc[17230](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:22:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:22:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:22:10.324352 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:45711
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:41525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:45711,127.3.217.189:34183,127.3.217.188:35289
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:22:10.408229 17243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:10.408504 17243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:10.408542 17243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:10.409679 17243 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:22:10.409749 17243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:10.409775 17243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:10.409796 17243 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:22:10.409824 17243 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:22:10.411413 17243 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:41525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:45711,127.3.217.189:34183,127.3.217.188:35289
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:45711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17243
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:10.411693 17243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:10.411931 17243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:10.417862 17251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:10.417863 17249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:10.417863 17248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:10.419019 17243 server_base.cc:1034] running on GCE node
I20260618 23:22:10.419359 17243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:10.419657 17243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:10.420837 17243 hybrid_clock.cc:648] HybridClock initialized: now 1781824930420816 us; error 40 us; skew 500 ppm
Jun 18 23:22:10 dist-test-slave-r9ct krb5kdc[17230](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824930, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:10.428871 17243 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:22:10.429900 17243 webserver.cc:460] Webserver started at http://127.3.217.190:34233/ using document root <none> and password file <none>
I20260618 23:22:10.430320 17243 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:10.430428 17243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:10.430946 17243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:22:10.432878 17243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "02acda7e8cf940b0bacb99ee515743b3"
format_stamp: "Formatted at 2026-06-18 23:22:10 on dist-test-slave-r9ct"
server_key: "04eb40046afa60fe37f073299757f7af"
server_key_iv: "cd5818af52ce0c4fc99c256eaa6e984f"
server_key_version: "encryptionkey@0"
I20260618 23:22:10.433427 17243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "02acda7e8cf940b0bacb99ee515743b3"
format_stamp: "Formatted at 2026-06-18 23:22:10 on dist-test-slave-r9ct"
server_key: "04eb40046afa60fe37f073299757f7af"
server_key_iv: "cd5818af52ce0c4fc99c256eaa6e984f"
server_key_version: "encryptionkey@0"
I20260618 23:22:10.435158 17243 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.002s
I20260618 23:22:10.436208 17258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:10.436525 17243 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:10.436672 17243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "02acda7e8cf940b0bacb99ee515743b3"
format_stamp: "Formatted at 2026-06-18 23:22:10 on dist-test-slave-r9ct"
server_key: "04eb40046afa60fe37f073299757f7af"
server_key_iv: "cd5818af52ce0c4fc99c256eaa6e984f"
server_key_version: "encryptionkey@0"
I20260618 23:22:10.436760 17243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:10.449062 17243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:10.452071 17243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:10.452266 17243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:10.457116 17243 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:45711
I20260618 23:22:10.457141 17310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:45711 every 8 connection(s)
I20260618 23:22:10.457511 17243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:22:10.458402 17311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:10.460120 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 17243
I20260618 23:22:10.460271 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:22:10.460150 17311 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:22:10.460496 3942 external_mini_cluster.cc:1428] Setting key 2ec16a2e40d04ad41dda5903bd7ddd85
WARNING: no policy specified for kudu/127.3.217.189@KRBTEST.COM; defaulting to no policy
Jun 18 23:22:10 dist-test-slave-r9ct krb5kdc[17230](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824930, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.189@KRBTEST.COM" created.
I20260618 23:22:10.474375 17314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.461533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33830 (local address 127.3.217.190:45711)
0618 23:22:10.461732 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:10.461737 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:10.461776 (+ 39us) server_negotiation.cc:407] Connection header received
0618 23:22:10.462836 (+ 1060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:10.462839 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:10.462864 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:10.462982 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:10.464268 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.465074 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.466679 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.467337 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.467470 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.470411 (+ 2941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:10.470420 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:10.470421 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:10.470430 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:10.472649 (+ 2219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.473160 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.473163 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.473163 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.473256 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.473482 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.473483 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.473484 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.473696 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:10.473781 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:10.473975 (+ 194us) server_negotiation.cc:299] Negotiation successful
0618 23:22:10.474113 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":99,"threads_started":1}
I20260618 23:22:10.474375 17313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.461239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:45711 (local address 127.0.0.1:33830)
0618 23:22:10.461512 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.461565 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:10.462492 (+ 927us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:10.463077 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:10.463080 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:10.463840 (+ 760us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:10.464106 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:10.464115 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.465196 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.465198 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:10.466573 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:10.466576 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.467484 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.467486 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:10.467598 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.468199 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:10.468212 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:10.470270 (+ 2058us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:10.472792 (+ 2522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:10.472797 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:10.472799 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:10.473061 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:10.473330 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:10.473331 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:10.473331 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:10.473417 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:10.473771 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:10.473776 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:10.473835 (+ 59us) client_negotiation.cc:769] Sending connection context
0618 23:22:10.473943 (+ 108us) client_negotiation.cc:240] Negotiation successful
0618 23:22:10.474174 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"mutex_wait_us":94,"thread_start_us":127,"threads_started":1}
I20260618 23:22:10.475157 17311 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:22:10.475524 17313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.475412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:34183 (local address 127.0.0.1:42820)
0618 23:22:10.475464 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.475504 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.189:34183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260618 23:22:10.475690 17260 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.217.189:34183: connect: Connection refused (error 111)
I20260618 23:22:10.476081 17313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.475995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:34183 (local address 127.0.0.1:42826)
0618 23:22:10.476041 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.476065 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.189:34183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260618 23:22:10.476236 17311 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.189:34183: Network error: Client connection negotiation failed: client connection to 127.3.217.189:34183: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.189.keytab.
Entry for principal kudu/127.3.217.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.189.keytab.
I20260618 23:22:10.491256 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.189:34183
--webserver_interface=127.3.217.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.189.keytab
--principal=kudu/127.3.217.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:41525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:45711,127.3.217.189:34183,127.3.217.188:35289
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260618 23:22:10.525610 17311 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } attempt: 1
I20260618 23:22:10.526178 17313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.526023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:34183 (local address 127.0.0.1:42830)
0618 23:22:10.526096 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.526143 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.189:34183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260618 23:22:10.526566 17313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.526476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:34183 (local address 127.0.0.1:42846)
0618 23:22:10.526520 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.526547 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.189:34183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260618 23:22:10.526666 17311 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.189:34183: Network error: Client connection negotiation failed: client connection to 127.3.217.189:34183: connect: Connection refused (error 111)
W20260618 23:22:10.574882 17318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:10.575093 17318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:10.575120 17318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:10.576300 17318 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:22:10.576345 17318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:10.576360 17318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:10.576372 17318 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:22:10.576385 17318 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:22:10.577878 17318 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:41525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:45711,127.3.217.189:34183,127.3.217.188:35289
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.189.keytab
--principal=kudu/127.3.217.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.189:34183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.3.217.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:10.578069 17318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:10.578251 17318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:10.583482 17324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:10.583688 17323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:10.583482 17326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:10.583722 17318 server_base.cc:1034] running on GCE node
I20260618 23:22:10.584053 17318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:10.584335 17318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:10.585515 17318 hybrid_clock.cc:648] HybridClock initialized: now 1781824930585488 us; error 44 us; skew 500 ppm
Jun 18 23:22:10 dist-test-slave-r9ct krb5kdc[17230](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824930, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:10.588624 17318 init.cc:377] Logged in from keytab as kudu/127.3.217.189@KRBTEST.COM (short username kudu)
I20260618 23:22:10.589135 17318 webserver.cc:460] Webserver started at http://127.3.217.189:41257/ using document root <none> and password file <none>
I20260618 23:22:10.589397 17318 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:10.589471 17318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:10.589629 17318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:22:10.590852 17318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-1/data/instance:
uuid: "9463b28a9c6e4051976f66846979e2fc"
format_stamp: "Formatted at 2026-06-18 23:22:10 on dist-test-slave-r9ct"
server_key: "b2947b9cb389e3c10c276fcc9edd269f"
server_key_iv: "2cb5dfe0af3ddde52144804ff4ba47da"
server_key_version: "encryptionkey@0"
I20260618 23:22:10.591246 17318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-1/wal/instance:
uuid: "9463b28a9c6e4051976f66846979e2fc"
format_stamp: "Formatted at 2026-06-18 23:22:10 on dist-test-slave-r9ct"
server_key: "b2947b9cb389e3c10c276fcc9edd269f"
server_key_iv: "2cb5dfe0af3ddde52144804ff4ba47da"
server_key_version: "encryptionkey@0"
I20260618 23:22:10.592753 17318 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260618 23:22:10.593562 17333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:10.593799 17318 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260618 23:22:10.593905 17318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-1/wal
uuid: "9463b28a9c6e4051976f66846979e2fc"
format_stamp: "Formatted at 2026-06-18 23:22:10 on dist-test-slave-r9ct"
server_key: "b2947b9cb389e3c10c276fcc9edd269f"
server_key_iv: "2cb5dfe0af3ddde52144804ff4ba47da"
server_key_version: "encryptionkey@0"
I20260618 23:22:10.593992 17318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:10.594792 17311 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } attempt: 2
I20260618 23:22:10.595167 17313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.595042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:34183 (local address 127.0.0.1:42856)
0618 23:22:10.595101 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.595131 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.189:34183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260618 23:22:10.595512 17313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.595439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:34183 (local address 127.0.0.1:42872)
0618 23:22:10.595467 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.595490 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.189:34183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260618 23:22:10.595606 17311 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.189:34183: Network error: Client connection negotiation failed: client connection to 127.3.217.189:34183: connect: Connection refused (error 111)
I20260618 23:22:10.610808 17318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:10.613077 17318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:10.613297 17318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:10.617725 17318 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.189:34183
I20260618 23:22:10.617769 17385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.189:34183 every 8 connection(s)
I20260618 23:22:10.618101 17318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-1/data/info.pb
I20260618 23:22:10.619002 17386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:10.620453 17386 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 } has no permanent_uuid. Determining permanent_uuid...
Jun 18 23:22:10 dist-test-slave-r9ct krb5kdc[17230](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824930, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.189@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:10.626557 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 17318
I20260618 23:22:10.626691 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-1/wal/instance
I20260618 23:22:10.626932 3942 external_mini_cluster.cc:1428] Setting key 98be51b699a3c9eb260d45e6b4f70cb5
I20260618 23:22:10.630338 17314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.621143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33836 (local address 127.3.217.190:45711)
0618 23:22:10.621212 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:10.621214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:10.621472 (+ 258us) server_negotiation.cc:407] Connection header received
0618 23:22:10.621894 (+ 422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:10.621895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:10.621908 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:10.621971 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:10.622645 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.623246 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.624230 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.624449 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.624512 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.626823 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:10.626825 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:10.626825 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:10.626834 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:10.628581 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.629166 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.629167 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.629167 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.629253 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.629609 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.629610 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.629610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.629721 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:10.629776 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:10.630107 (+ 331us) server_negotiation.cc:299] Negotiation successful
0618 23:22:10.630248 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260618 23:22:10.630530 17388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.621120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:45711 (local address 127.0.0.1:33836)
0618 23:22:10.621286 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.621333 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:10.621802 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:10.622050 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:10.622053 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:10.622345 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:10.622528 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:10.622532 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.623357 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.623358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:10.624134 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:10.624136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.624528 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.624529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:10.624630 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.625139 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:10.625146 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:10.626674 (+ 1528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:10.628721 (+ 2047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:10.628729 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:10.628732 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:10.629070 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:10.629366 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:10.629367 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:10.629367 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:10.629514 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:10.629791 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:10.629796 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:10.629964 (+ 168us) client_negotiation.cc:769] Sending connection context
0618 23:22:10.630079 (+ 115us) client_negotiation.cc:240] Negotiation successful
0618 23:22:10.630255 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":83,"threads_started":1}
I20260618 23:22:10.631417 17386 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.3.217.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.188@KRBTEST.COM" created.
Jun 18 23:22:10 dist-test-slave-r9ct krb5kdc[17230](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824930, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.189@KRBTEST.COM for kudu/127.3.217.189@KRBTEST.COM
I20260618 23:22:10.642398 17390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.631938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42876 (local address 127.3.217.189:34183)
0618 23:22:10.632114 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:10.632118 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:10.632137 (+ 19us) server_negotiation.cc:407] Connection header received
0618 23:22:10.632167 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:10.632168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:10.632179 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:10.632247 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:10.632615 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.633324 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.634360 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.634695 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.634850 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.639456 (+ 4606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:10.639465 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:10.639465 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:10.639473 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:10.641100 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.641518 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.641520 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.641521 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.641579 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.641791 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.641792 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.641792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.641929 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:10.641991 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:10.642157 (+ 166us) server_negotiation.cc:299] Negotiation successful
0618 23:22:10.642301 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":147,"thread_start_us":122,"threads_started":1}
I20260618 23:22:10.642418 17388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.631816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:34183 (local address 127.0.0.1:42876)
0618 23:22:10.631867 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.631876 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:10.631914 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:10.632278 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:10.632279 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:10.632444 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:10.632517 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:10.632519 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.633418 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.633419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:10.634267 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:10.634270 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.634862 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.634863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:10.634944 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.635382 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:10.635387 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:10.639374 (+ 3987us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:10.641180 (+ 1806us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:10.641180 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:10.641181 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:10.641409 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:10.641655 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:10.641656 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:10.641657 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:10.641727 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:10.641995 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:10.641996 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:10.642043 (+ 47us) client_negotiation.cc:769] Sending connection context
0618 23:22:10.642122 (+ 79us) client_negotiation.cc:240] Negotiation successful
0618 23:22:10.642237 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260618 23:22:10.643278 17386 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:22:10.643710 17388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.643590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35289 (local address 127.0.0.1:44638)
0618 23:22:10.643647 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.643692 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:35289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260618 23:22:10.643873 17337 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.217.188:35289: connect: Connection refused (error 111)
I20260618 23:22:10.644347 17388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.644207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35289 (local address 127.0.0.1:44654)
0618 23:22:10.644299 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.644328 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:35289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260618 23:22:10.644505 17386 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.188:35289: Network error: Client connection negotiation failed: client connection to 127.3.217.188:35289: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.188.keytab.
Entry for principal kudu/127.3.217.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.188.keytab.
I20260618 23:22:10.659159 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.188:35289
--webserver_interface=127.3.217.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.188.keytab
--principal=kudu/127.3.217.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:41525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:45711,127.3.217.189:34183,127.3.217.188:35289
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260618 23:22:10.686820 17311 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } attempt: 3
Jun 18 23:22:10 dist-test-slave-r9ct krb5kdc[17230](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824930, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for kudu/127.3.217.189@KRBTEST.COM
I20260618 23:22:10.693806 17386 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } attempt: 1
I20260618 23:22:10.694298 17388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.694163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35289 (local address 127.0.0.1:44658)
0618 23:22:10.694227 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.694262 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:35289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260618 23:22:10.694689 17388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.694584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35289 (local address 127.0.0.1:44662)
0618 23:22:10.694636 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.694659 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:35289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260618 23:22:10.694793 17386 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.188:35289: Network error: Client connection negotiation failed: client connection to 127.3.217.188:35289: connect: Connection refused (error 111)
I20260618 23:22:10.695681 17313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.687168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:34183 (local address 127.0.0.1:42878)
0618 23:22:10.687362 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.687381 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:10.687489 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:10.687659 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:10.687660 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:10.687845 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:10.687919 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:10.687921 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.688940 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.688941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:10.689766 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:10.689769 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.690190 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.690190 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:10.690269 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.690743 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:10.690749 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:10.692574 (+ 1825us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:10.694644 (+ 2070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:10.694646 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:10.694646 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:10.694930 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:10.695137 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:10.695138 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:10.695138 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:10.695189 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:10.695447 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:10.695448 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:10.695489 (+ 41us) client_negotiation.cc:769] Sending connection context
0618 23:22:10.695541 (+ 52us) client_negotiation.cc:240] Negotiation successful
0618 23:22:10.695618 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81}
I20260618 23:22:10.695753 17390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.687312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42878 (local address 127.3.217.189:34183)
0618 23:22:10.687376 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:10.687378 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:10.687539 (+ 161us) server_negotiation.cc:407] Connection header received
0618 23:22:10.687568 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:10.687569 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:10.687581 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:10.687624 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:10.688029 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.688794 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.689888 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.690105 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.690173 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.692723 (+ 2550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:10.692724 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:10.692725 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:10.692734 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:10.694545 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.695001 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.695003 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.695003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.695066 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.695247 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.695247 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.695248 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.695383 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:10.695448 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:10.695581 (+ 133us) server_negotiation.cc:299] Negotiation successful
0618 23:22:10.695671 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260618 23:22:10.696125 17311 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:22:10.696475 17313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.696361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35289 (local address 127.0.0.1:44672)
0618 23:22:10.696412 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.696446 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:35289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260618 23:22:10.696794 17313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.696700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35289 (local address 127.0.0.1:44676)
0618 23:22:10.696745 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.696775 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:35289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260618 23:22:10.696908 17311 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.188:35289: Network error: Client connection negotiation failed: client connection to 127.3.217.188:35289: connect: Connection refused (error 111)
I20260618 23:22:10.728071 17311 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } attempt: 1
I20260618 23:22:10.728680 17313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.728509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35289 (local address 127.0.0.1:44686)
0618 23:22:10.728577 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.728638 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:35289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260618 23:22:10.729121 17313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.729017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35289 (local address 127.0.0.1:44694)
0618 23:22:10.729065 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.729096 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:35289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260618 23:22:10.729336 17311 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.188:35289: Network error: Client connection negotiation failed: client connection to 127.3.217.188:35289: connect: Connection refused (error 111)
W20260618 23:22:10.751698 17393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:10.751936 17393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:10.751962 17393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:10.753106 17393 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:22:10.753150 17393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:10.753166 17393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:10.753180 17393 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:22:10.753192 17393 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:22:10.754675 17393 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:41525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:45711,127.3.217.189:34183,127.3.217.188:35289
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.188.keytab
--principal=kudu/127.3.217.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.188:35289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.3.217.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17393
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:10.754902 17393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:10.755080 17393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260618 23:22:10.760432 17393 server_base.cc:1034] running on GCE node
W20260618 23:22:10.760497 17399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:10.760449 17401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:10.760612 17398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:10.761055 17393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:10.761365 17393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:10.762542 17393 hybrid_clock.cc:648] HybridClock initialized: now 1781824930762528 us; error 51 us; skew 500 ppm
I20260618 23:22:10.762935 17386 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } attempt: 2
I20260618 23:22:10.763332 17388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.763205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35289 (local address 127.0.0.1:44696)
0618 23:22:10.763271 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.763306 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:35289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260618 23:22:10.764173 17388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.764074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35289 (local address 127.0.0.1:44704)
0618 23:22:10.764115 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.764147 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:35289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260618 23:22:10.764367 17386 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.188:35289: Network error: Client connection negotiation failed: client connection to 127.3.217.188:35289: connect: Connection refused (error 111)
Jun 18 23:22:10 dist-test-slave-r9ct krb5kdc[17230](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824930, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:10.766283 17393 init.cc:377] Logged in from keytab as kudu/127.3.217.188@KRBTEST.COM (short username kudu)
I20260618 23:22:10.766959 17393 webserver.cc:460] Webserver started at http://127.3.217.188:38793/ using document root <none> and password file <none>
I20260618 23:22:10.767200 17393 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:10.767262 17393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:10.767391 17393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:22:10.768510 17393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-2/data/instance:
uuid: "ce604460122947b8ac262d9f4ad0a660"
format_stamp: "Formatted at 2026-06-18 23:22:10 on dist-test-slave-r9ct"
server_key: "a2ea66f082ecc563bde79ea8d8da6f60"
server_key_iv: "fc16b83890b6d64eee5a6ebd2e65b808"
server_key_version: "encryptionkey@0"
I20260618 23:22:10.768877 17393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-2/wal/instance:
uuid: "ce604460122947b8ac262d9f4ad0a660"
format_stamp: "Formatted at 2026-06-18 23:22:10 on dist-test-slave-r9ct"
server_key: "a2ea66f082ecc563bde79ea8d8da6f60"
server_key_iv: "fc16b83890b6d64eee5a6ebd2e65b808"
server_key_version: "encryptionkey@0"
I20260618 23:22:10.770226 17393 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:22:10.771153 17408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:10.771415 17393 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:22:10.771521 17393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-2/wal
uuid: "ce604460122947b8ac262d9f4ad0a660"
format_stamp: "Formatted at 2026-06-18 23:22:10 on dist-test-slave-r9ct"
server_key: "a2ea66f082ecc563bde79ea8d8da6f60"
server_key_iv: "fc16b83890b6d64eee5a6ebd2e65b808"
server_key_version: "encryptionkey@0"
I20260618 23:22:10.771608 17393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:10.782914 17393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:10.785281 17393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:10.785439 17393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:10.789546 17393 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.188:35289
I20260618 23:22:10.789575 17460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.188:35289 every 8 connection(s)
I20260618 23:22:10.789924 17393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-2/data/info.pb
I20260618 23:22:10.790910 17461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:10.792591 17461 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:22:10.794562 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 17393
I20260618 23:22:10.794704 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781824769284800-3942-0/minicluster-data/master-2/wal/instance
I20260618 23:22:10.794922 3942 external_mini_cluster.cc:1428] Setting key 88c04cdaa8c6ef4997cdb482f2f0454a
Jun 18 23:22:10 dist-test-slave-r9ct krb5kdc[17230](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824930, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.188@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
Jun 18 23:22:10 dist-test-slave-r9ct krb5kdc[17230](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.188@KRBTEST.COM
I20260618 23:22:10.803516 17463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.793289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:45711 (local address 127.0.0.1:33844)
0618 23:22:10.793520 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.793563 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:10.794072 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:10.794326 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:10.794330 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:10.794592 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:10.794894 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:10.794899 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.795869 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.795870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:10.796974 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:10.796977 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.797515 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.797516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:10.797715 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.798309 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:10.798319 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:10.800066 (+ 1747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:10.801924 (+ 1858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:10.801936 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:10.801938 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:10.802179 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:10.802407 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:10.802408 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:10.802408 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:10.802518 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:10.802839 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:10.802844 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:10.802959 (+ 115us) client_negotiation.cc:769] Sending connection context
0618 23:22:10.803051 (+ 92us) client_negotiation.cc:240] Negotiation successful
0618 23:22:10.803240 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":113,"threads_started":1}
I20260618 23:22:10.803556 17314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.793407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33844 (local address 127.3.217.190:45711)
0618 23:22:10.793503 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:10.793505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:10.793655 (+ 150us) server_negotiation.cc:407] Connection header received
0618 23:22:10.794185 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:10.794186 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:10.794198 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:10.794254 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:10.794996 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.795728 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.797050 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.797410 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.797483 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.800155 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:10.800156 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:10.800157 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:10.800164 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:10.801832 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.802269 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.802270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.802271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.802337 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.802591 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.802592 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.802592 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.802706 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:10.802807 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:10.803201 (+ 394us) server_negotiation.cc:299] Negotiation successful
0618 23:22:10.803444 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260618 23:22:10.804136 17461 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:22:10.804527 17311 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } attempt: 2
I20260618 23:22:10.805946 17465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.795385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44712 (local address 127.3.217.188:35289)
0618 23:22:10.795597 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:10.795601 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:10.795624 (+ 23us) server_negotiation.cc:407] Connection header received
0618 23:22:10.795644 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:10.795645 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:10.795662 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:10.795738 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:10.796668 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.797634 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.798579 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.798924 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.798981 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.802127 (+ 3146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:10.802150 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:10.802151 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:10.802164 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:10.804412 (+ 2248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.805082 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.805085 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.805085 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.805146 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.805350 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.805351 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.805352 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.805510 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:10.805680 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:10.805767 (+ 87us) server_negotiation.cc:299] Negotiation successful
0618 23:22:10.805841 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":136,"threads_started":1}
Jun 18 23:22:10 dist-test-slave-r9ct krb5kdc[17230](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824930, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for kudu/127.3.217.188@KRBTEST.COM
Jun 18 23:22:10 dist-test-slave-r9ct krb5kdc[17230](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824930, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.188@KRBTEST.COM for kudu/127.3.217.189@KRBTEST.COM
Jun 18 23:22:10 dist-test-slave-r9ct krb5kdc[17230](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:10.813385 17390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.804773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42888 (local address 127.3.217.189:34183)
0618 23:22:10.804827 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:10.804829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:10.804884 (+ 55us) server_negotiation.cc:407] Connection header received
0618 23:22:10.804953 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:10.804954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:10.804966 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:10.805051 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:10.805355 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.806180 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.807109 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.807420 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.807506 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.810469 (+ 2963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:10.810470 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:10.810471 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:10.810478 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:10.811984 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.812377 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.812378 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.812379 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.812440 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.812762 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.812763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.812764 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.812911 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:10.812981 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:10.813175 (+ 194us) server_negotiation.cc:299] Negotiation successful
0618 23:22:10.813266 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260618 23:22:10.813464 17463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.804660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:34183 (local address 127.0.0.1:42888)
0618 23:22:10.804824 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.804836 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:10.804895 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:10.805060 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:10.805061 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:10.805225 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:10.805267 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:10.805269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.806299 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.806300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:10.806978 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:10.806980 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.807506 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.807507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:10.807570 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.808571 (+ 1001us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:10.808575 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:10.810369 (+ 1794us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:10.812092 (+ 1723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:10.812093 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:10.812094 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:10.812290 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:10.812575 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:10.812576 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:10.812577 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:10.812661 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:10.812989 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:10.812989 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:10.813041 (+ 52us) client_negotiation.cc:769] Sending connection context
0618 23:22:10.813123 (+ 82us) client_negotiation.cc:240] Negotiation successful
0618 23:22:10.813333 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146}
I20260618 23:22:10.814646 17461 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:22:10.814893 17313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.804826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35289 (local address 127.0.0.1:44726)
0618 23:22:10.804865 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.804876 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:10.804921 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:10.805140 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:10.805141 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:10.805288 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:10.805356 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:10.805358 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.806248 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.806249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:10.807092 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:10.807095 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.807600 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.807601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:10.807662 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.808328 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:10.808333 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:10.810291 (+ 1958us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:10.813612 (+ 3321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:10.813613 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:10.813614 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:10.813846 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:10.814073 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:10.814074 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:10.814074 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:10.814154 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:10.814492 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:10.814494 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:10.814544 (+ 50us) client_negotiation.cc:769] Sending connection context
0618 23:22:10.814631 (+ 87us) client_negotiation.cc:240] Negotiation successful
0618 23:22:10.814788 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260618 23:22:10.814910 17466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.804870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44726 (local address 127.3.217.188:35289)
0618 23:22:10.805023 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:10.805025 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:10.805032 (+ 7us) server_negotiation.cc:407] Connection header received
0618 23:22:10.805050 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:10.805051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:10.805060 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:10.805122 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:10.805421 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.806151 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.807166 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.807507 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.807588 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.810389 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:10.810391 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:10.810392 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:10.810399 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:10.813503 (+ 3104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.813935 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.813936 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.813936 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.813994 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.814233 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.814234 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.814234 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.814372 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:10.814462 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:10.814672 (+ 210us) server_negotiation.cc:299] Negotiation successful
0618 23:22:10.814772 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":97,"threads_started":1}
I20260618 23:22:10.816522 17314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.807071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33852 (local address 127.3.217.190:45711)
0618 23:22:10.807106 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:10.807108 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:10.807248 (+ 140us) server_negotiation.cc:407] Connection header received
0618 23:22:10.807287 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:10.807288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:10.807297 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:10.807353 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:10.807963 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.808481 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.809506 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.809774 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.809839 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.813435 (+ 3596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:10.813437 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:10.813437 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:10.813444 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:10.815342 (+ 1898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.815717 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.815718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.815718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.815771 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.815975 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.815976 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.815976 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.816105 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:10.816308 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:10.816343 (+ 35us) server_negotiation.cc:299] Negotiation successful
0618 23:22:10.816414 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260618 23:22:10.817248 17311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3: Bootstrap starting.
I20260618 23:22:10.818063 17311 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3: Neither blocks nor log segments found. Creating new log.
I20260618 23:22:10.818301 17311 log.cc:824] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:10.819344 17311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3: No bootstrap required, opened a new log
Jun 18 23:22:10 dist-test-slave-r9ct krb5kdc[17230](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824930, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.188@KRBTEST.COM for kudu/127.3.217.188@KRBTEST.COM
Jun 18 23:22:10 dist-test-slave-r9ct krb5kdc[17230](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.189@KRBTEST.COM
I20260618 23:22:10.821717 17311 raft_consensus.cc:348] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02acda7e8cf940b0bacb99ee515743b3" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 } } peers { permanent_uuid: "9463b28a9c6e4051976f66846979e2fc" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } } peers { permanent_uuid: "ce604460122947b8ac262d9f4ad0a660" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } }
I20260618 23:22:10.821877 17311 raft_consensus.cc:374] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:22:10.821918 17311 raft_consensus.cc:729] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02acda7e8cf940b0bacb99ee515743b3, State: Initialized, Role: FOLLOWER
I20260618 23:22:10.822178 17311 consensus_queue.cc:260] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02acda7e8cf940b0bacb99ee515743b3" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 } } peers { permanent_uuid: "9463b28a9c6e4051976f66846979e2fc" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } } peers { permanent_uuid: "ce604460122947b8ac262d9f4ad0a660" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } }
I20260618 23:22:10.822551 17311 sys_catalog.cc:564] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:22:10.822552 17468 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02acda7e8cf940b0bacb99ee515743b3" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 } } peers { permanent_uuid: "9463b28a9c6e4051976f66846979e2fc" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } } peers { permanent_uuid: "ce604460122947b8ac262d9f4ad0a660" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } } }
I20260618 23:22:10.822832 17468 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3 [sys.catalog]: This master's current role is: FOLLOWER
I20260618 23:22:10.823733 17463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.814920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35289 (local address 127.0.0.1:44730)
0618 23:22:10.815346 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.815357 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:10.815396 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:10.815521 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:10.815521 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:10.815650 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:10.815678 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:10.815679 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.816502 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.816503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:10.817250 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:10.817252 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.817650 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.817651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:10.817697 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.818598 (+ 901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:10.818603 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:10.819973 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:10.821567 (+ 1594us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:10.821568 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:10.821568 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:10.821734 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:10.821928 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:10.821929 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:10.821929 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:10.821980 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:10.822470 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:10.822471 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:10.822516 (+ 45us) client_negotiation.cc:769] Sending connection context
0618 23:22:10.823020 (+ 504us) client_negotiation.cc:240] Negotiation successful
0618 23:22:10.823143 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412}
I20260618 23:22:10.823822 17466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.814989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44730 (local address 127.3.217.188:35289)
0618 23:22:10.815082 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:10.815084 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:10.815445 (+ 361us) server_negotiation.cc:407] Connection header received
0618 23:22:10.815460 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:10.815461 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:10.815468 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:10.815505 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:10.815781 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.816421 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.817333 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.817579 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.817653 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.820060 (+ 2407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:10.820061 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:10.820061 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:10.820067 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:10.821478 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.821817 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.821817 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.821818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.821871 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.822051 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.822052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.822052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.822364 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:10.822442 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:10.823051 (+ 609us) server_negotiation.cc:299] Negotiation successful
0618 23:22:10.823350 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":106,"server-negotiator.queue_time_us":75}
I20260618 23:22:10.826530 17461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660: Bootstrap starting.
I20260618 23:22:10.827225 17390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.817266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42900 (local address 127.3.217.189:34183)
0618 23:22:10.817301 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:10.817303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:10.817313 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:22:10.817335 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:10.817336 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:10.817344 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:10.817393 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:10.817977 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.818474 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.819398 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.819654 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.819722 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.822328 (+ 2606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:10.822329 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:10.822330 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:10.822338 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:10.825441 (+ 3103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.825956 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.825958 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.825958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.826019 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.826252 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.826254 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.826301 (+ 47us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.826464 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:10.826627 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:10.827054 (+ 427us) server_negotiation.cc:299] Negotiation successful
0618 23:22:10.827132 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260618 23:22:10.827354 17461 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660: Neither blocks nor log segments found. Creating new log.
I20260618 23:22:10.827651 17461 log.cc:824] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:10.825660 17243 master_runner.cc:186] Error getting master registration for 127.3.217.189:34183: OK, instance_id { permanent_uuid: "9463b28a9c6e4051976f66846979e2fc" instance_seqno: 1781824930616518 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260618 23:22:10.828096 17243 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260618 23:22:10.828220 17479 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260618 23:22:10.828339 17479 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260618 23:22:10.828495 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:22:10.828789 17461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660: No bootstrap required, opened a new log
I20260618 23:22:10.831115 17461 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02acda7e8cf940b0bacb99ee515743b3" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 } } peers { permanent_uuid: "9463b28a9c6e4051976f66846979e2fc" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } } peers { permanent_uuid: "ce604460122947b8ac262d9f4ad0a660" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } }
I20260618 23:22:10.831387 17461 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:22:10.831485 17461 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce604460122947b8ac262d9f4ad0a660, State: Initialized, Role: FOLLOWER
I20260618 23:22:10.831691 17461 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02acda7e8cf940b0bacb99ee515743b3" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 } } peers { permanent_uuid: "9463b28a9c6e4051976f66846979e2fc" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } } peers { permanent_uuid: "ce604460122947b8ac262d9f4ad0a660" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } }
I20260618 23:22:10.832086 17461 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [sys.catalog]: configured and running, proceeding with master startup.
W20260618 23:22:10.834393 17500 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260618 23:22:10.834594 17500 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260618 23:22:10.836105 17393 master_runner.cc:186] Error getting master registration for 127.3.217.189:34183: OK, instance_id { permanent_uuid: "9463b28a9c6e4051976f66846979e2fc" instance_seqno: 1781824930616518 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260618 23:22:10.840096 17393 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260618 23:22:10.840271 17489 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02acda7e8cf940b0bacb99ee515743b3" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 } } peers { permanent_uuid: "9463b28a9c6e4051976f66846979e2fc" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } } peers { permanent_uuid: "ce604460122947b8ac262d9f4ad0a660" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } } }
I20260618 23:22:10.840448 17489 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [sys.catalog]: This master's current role is: FOLLOWER
I20260618 23:22:10.840864 17314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.830063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33868 (local address 127.3.217.190:45711)
0618 23:22:10.830103 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:10.830105 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:10.831251 (+ 1146us) server_negotiation.cc:407] Connection header received
0618 23:22:10.831357 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:10.831358 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:10.831369 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:10.831401 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:10.832096 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.832873 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.834243 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.834579 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.834620 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.837077 (+ 2457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:10.837079 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:10.837079 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:10.837091 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:10.839371 (+ 2280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.839884 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.839885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.839886 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.839946 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.840169 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.840170 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.840170 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.840325 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:10.840415 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:10.840644 (+ 229us) server_negotiation.cc:299] Negotiation successful
0618 23:22:10.840739 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260618 23:22:10.841536 17390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.829839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42902 (local address 127.3.217.189:34183)
0618 23:22:10.829882 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:10.829884 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:10.831047 (+ 1163us) server_negotiation.cc:407] Connection header received
0618 23:22:10.831129 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:10.831130 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:10.831142 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:10.831201 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:10.832022 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.832847 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.834194 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.834521 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.834584 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.837077 (+ 2493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:10.837079 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:10.837079 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:10.837091 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:10.839557 (+ 2466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.839971 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.839972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.839973 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.840027 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.840280 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.840281 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.840282 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.840404 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:10.840941 (+ 537us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:10.841336 (+ 395us) server_negotiation.cc:299] Negotiation successful
0618 23:22:10.841415 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260618 23:22:10.848459 17466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.830253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44734 (local address 127.3.217.188:35289)
0618 23:22:10.830308 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:10.830311 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:10.842034 (+ 11723us) server_negotiation.cc:407] Connection header received
0618 23:22:10.842104 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:10.842106 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:10.842116 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:10.842167 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:10.842653 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.843223 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.843904 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.844099 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.844176 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.845352 (+ 1176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:10.845353 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:10.845354 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:10.845361 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:10.847174 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.847528 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.847529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.847530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.847584 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.847783 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.847784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.847785 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.847902 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:10.848026 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:10.848124 (+ 98us) server_negotiation.cc:299] Negotiation successful
0618 23:22:10.848200 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260618 23:22:10.855528 17386 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } attempt: 3
Jun 18 23:22:10 dist-test-slave-r9ct krb5kdc[17230](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824930, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.189@KRBTEST.COM for kudu/127.3.217.188@KRBTEST.COM
I20260618 23:22:10.862556 17466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.855884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44742 (local address 127.3.217.188:35289)
0618 23:22:10.855922 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:10.855924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:10.855953 (+ 29us) server_negotiation.cc:407] Connection header received
0618 23:22:10.856049 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:10.856050 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:10.856061 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:10.856134 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:10.856415 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.857096 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.857797 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.857962 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.858040 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.859863 (+ 1823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:10.859865 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:10.859865 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:10.859872 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:10.861233 (+ 1361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.861584 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.861586 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.861586 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.861640 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:10.861841 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:10.861842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:10.861843 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:10.861953 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:10.862027 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:10.862177 (+ 150us) server_negotiation.cc:299] Negotiation successful
0618 23:22:10.862463 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260618 23:22:10.862541 17388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:10.855850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:35289 (local address 127.0.0.1:44742)
0618 23:22:10.855902 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:10.855915 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:10.855966 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:10.856138 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:10.856139 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:10.856294 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:10.856333 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:10.856335 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.857183 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.857183 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:10.857722 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:10.857724 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:10.858037 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:10.858038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:10.858088 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:10.858545 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:10.858552 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:10.859778 (+ 1226us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:10.861331 (+ 1553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:10.861332 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:10.861333 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:10.861500 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:10.861705 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:10.861706 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:10.861706 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:10.861768 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:10.862018 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:10.862019 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:10.862067 (+ 48us) client_negotiation.cc:769] Sending connection context
0618 23:22:10.862153 (+ 86us) client_negotiation.cc:240] Negotiation successful
0618 23:22:10.862411 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260618 23:22:10.865334 17386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc: Bootstrap starting.
I20260618 23:22:10.866008 17386 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc: Neither blocks nor log segments found. Creating new log.
I20260618 23:22:10.866336 17386 log.cc:824] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:10.867640 17386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc: No bootstrap required, opened a new log
I20260618 23:22:10.869051 17386 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02acda7e8cf940b0bacb99ee515743b3" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 } } peers { permanent_uuid: "9463b28a9c6e4051976f66846979e2fc" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } } peers { permanent_uuid: "ce604460122947b8ac262d9f4ad0a660" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } }
I20260618 23:22:10.869186 17386 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:22:10.869248 17386 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9463b28a9c6e4051976f66846979e2fc, State: Initialized, Role: FOLLOWER
I20260618 23:22:10.869398 17386 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02acda7e8cf940b0bacb99ee515743b3" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 } } peers { permanent_uuid: "9463b28a9c6e4051976f66846979e2fc" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } } peers { permanent_uuid: "ce604460122947b8ac262d9f4ad0a660" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } }
I20260618 23:22:10.869685 17503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02acda7e8cf940b0bacb99ee515743b3" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 } } peers { permanent_uuid: "9463b28a9c6e4051976f66846979e2fc" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } } peers { permanent_uuid: "ce604460122947b8ac262d9f4ad0a660" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } } }
I20260618 23:22:10.869769 17386 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:22:10.869820 17503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc [sys.catalog]: This master's current role is: FOLLOWER
W20260618 23:22:10.872244 17514 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260618 23:22:10.872346 17514 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260618 23:22:10.874061 17318 master_runner.cc:263] No leader master found from master 9463b28a9c6e4051976f66846979e2fc
I20260618 23:22:10.874106 17318 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260618 23:22:10.953143 17264 tablet.cc:2369] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260618 23:22:11.036091 17414 tablet.cc:2369] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260618 23:22:11.114391 17339 tablet.cc:2369] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 23:22:11.182839 17489 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:22:11.182977 17489 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02acda7e8cf940b0bacb99ee515743b3" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 } } peers { permanent_uuid: "9463b28a9c6e4051976f66846979e2fc" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } } peers { permanent_uuid: "ce604460122947b8ac262d9f4ad0a660" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } }
I20260618 23:22:11.183208 17489 leader_election.cc:288] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02acda7e8cf940b0bacb99ee515743b3 (127.3.217.190:45711), 9463b28a9c6e4051976f66846979e2fc (127.3.217.189:34183)
I20260618 23:22:11.183486 17285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ce604460122947b8ac262d9f4ad0a660" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02acda7e8cf940b0bacb99ee515743b3" is_pre_election: true
I20260618 23:22:11.183610 17285 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce604460122947b8ac262d9f4ad0a660 in term 0.
I20260618 23:22:11.183629 17360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ce604460122947b8ac262d9f4ad0a660" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9463b28a9c6e4051976f66846979e2fc" is_pre_election: true
I20260618 23:22:11.183843 17360 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce604460122947b8ac262d9f4ad0a660 in term 0.
I20260618 23:22:11.183825 17412 leader_election.cc:302] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02acda7e8cf940b0bacb99ee515743b3, ce604460122947b8ac262d9f4ad0a660; no voters:
I20260618 23:22:11.183995 17489 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:22:11.184064 17489 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:22:11.184094 17489 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:22:11.184860 17489 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02acda7e8cf940b0bacb99ee515743b3" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 } } peers { permanent_uuid: "9463b28a9c6e4051976f66846979e2fc" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } } peers { permanent_uuid: "ce604460122947b8ac262d9f4ad0a660" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } }
I20260618 23:22:11.184994 17489 leader_election.cc:288] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [CANDIDATE]: Term 1 election: Requested vote from peers 02acda7e8cf940b0bacb99ee515743b3 (127.3.217.190:45711), 9463b28a9c6e4051976f66846979e2fc (127.3.217.189:34183)
I20260618 23:22:11.185132 17285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ce604460122947b8ac262d9f4ad0a660" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02acda7e8cf940b0bacb99ee515743b3"
I20260618 23:22:11.185211 17285 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:22:11.185298 17360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ce604460122947b8ac262d9f4ad0a660" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9463b28a9c6e4051976f66846979e2fc"
I20260618 23:22:11.185391 17360 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:22:11.185966 17285 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce604460122947b8ac262d9f4ad0a660 in term 1.
I20260618 23:22:11.186245 17360 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce604460122947b8ac262d9f4ad0a660 in term 1.
I20260618 23:22:11.186291 17412 leader_election.cc:302] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02acda7e8cf940b0bacb99ee515743b3, ce604460122947b8ac262d9f4ad0a660; no voters:
I20260618 23:22:11.186525 17489 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:22:11.186668 17489 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [term 1 LEADER]: Becoming Leader. State: Replica: ce604460122947b8ac262d9f4ad0a660, State: Running, Role: LEADER
I20260618 23:22:11.186805 17489 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02acda7e8cf940b0bacb99ee515743b3" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 } } peers { permanent_uuid: "9463b28a9c6e4051976f66846979e2fc" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } } peers { permanent_uuid: "ce604460122947b8ac262d9f4ad0a660" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } }
I20260618 23:22:11.187306 17516 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce604460122947b8ac262d9f4ad0a660. Latest consensus state: current_term: 1 leader_uuid: "ce604460122947b8ac262d9f4ad0a660" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02acda7e8cf940b0bacb99ee515743b3" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 } } peers { permanent_uuid: "9463b28a9c6e4051976f66846979e2fc" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } } peers { permanent_uuid: "ce604460122947b8ac262d9f4ad0a660" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } } }
I20260618 23:22:11.187410 17516 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [sys.catalog]: This master's current role is: LEADER
I20260618 23:22:11.187618 17518 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:22:11.187816 17518 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:22:11.189663 17360 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc [term 1 FOLLOWER]: Refusing update from remote peer ce604460122947b8ac262d9f4ad0a660: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:22:11.189771 17285 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3 [term 1 FOLLOWER]: Refusing update from remote peer ce604460122947b8ac262d9f4ad0a660: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:22:11.190145 17489 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9463b28a9c6e4051976f66846979e2fc" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:22:11.190383 17516 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02acda7e8cf940b0bacb99ee515743b3" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:22:11.191519 17468 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce604460122947b8ac262d9f4ad0a660. Latest consensus state: current_term: 1 leader_uuid: "ce604460122947b8ac262d9f4ad0a660" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02acda7e8cf940b0bacb99ee515743b3" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 } } peers { permanent_uuid: "9463b28a9c6e4051976f66846979e2fc" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } } peers { permanent_uuid: "ce604460122947b8ac262d9f4ad0a660" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } } }
I20260618 23:22:11.191520 17503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce604460122947b8ac262d9f4ad0a660. Latest consensus state: current_term: 1 leader_uuid: "ce604460122947b8ac262d9f4ad0a660" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02acda7e8cf940b0bacb99ee515743b3" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 } } peers { permanent_uuid: "9463b28a9c6e4051976f66846979e2fc" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } } peers { permanent_uuid: "ce604460122947b8ac262d9f4ad0a660" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } } }
I20260618 23:22:11.191613 17468 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3 [sys.catalog]: This master's current role is: FOLLOWER
I20260618 23:22:11.191613 17503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc [sys.catalog]: This master's current role is: FOLLOWER
I20260618 23:22:11.192420 17519 mvcc.cc:205] Tried to move back new op lower bound from 7298354918148771840 to 7298354918141820928. Current Snapshot: MvccSnapshot[applied={T|T < 7298354918148771840}]
I20260618 23:22:11.192523 17489 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ce604460122947b8ac262d9f4ad0a660" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02acda7e8cf940b0bacb99ee515743b3" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 } } peers { permanent_uuid: "9463b28a9c6e4051976f66846979e2fc" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } } peers { permanent_uuid: "ce604460122947b8ac262d9f4ad0a660" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } } }
I20260618 23:22:11.192595 17489 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [sys.catalog]: This master's current role is: LEADER
I20260618 23:22:11.192595 17516 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ce604460122947b8ac262d9f4ad0a660" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02acda7e8cf940b0bacb99ee515743b3" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 } } peers { permanent_uuid: "9463b28a9c6e4051976f66846979e2fc" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } } peers { permanent_uuid: "ce604460122947b8ac262d9f4ad0a660" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } } }
I20260618 23:22:11.192714 17516 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660 [sys.catalog]: This master's current role is: LEADER
I20260618 23:22:11.192775 17468 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ce604460122947b8ac262d9f4ad0a660" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02acda7e8cf940b0bacb99ee515743b3" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 } } peers { permanent_uuid: "9463b28a9c6e4051976f66846979e2fc" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } } peers { permanent_uuid: "ce604460122947b8ac262d9f4ad0a660" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } } }
I20260618 23:22:11.192889 17468 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3 [sys.catalog]: This master's current role is: FOLLOWER
I20260618 23:22:11.193025 17518 catalog_manager.cc:1347] Generated new cluster ID: f54a5990a9164171a14a8b1bcd13ef53
I20260618 23:22:11.193073 17518 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:22:11.195292 17503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ce604460122947b8ac262d9f4ad0a660" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02acda7e8cf940b0bacb99ee515743b3" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45711 } } peers { permanent_uuid: "9463b28a9c6e4051976f66846979e2fc" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 34183 } } peers { permanent_uuid: "ce604460122947b8ac262d9f4ad0a660" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 35289 } } }
I20260618 23:22:11.195387 17503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc [sys.catalog]: This master's current role is: FOLLOWER
I20260618 23:22:11.217334 17518 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:22:11.218021 17518 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:22:11.225144 17518 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce604460122947b8ac262d9f4ad0a660: Generated new TSK 0
I20260618 23:22:11.225348 17518 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:22:11.828814 17479 catalog_manager.cc:1259] Loaded cluster ID: f54a5990a9164171a14a8b1bcd13ef53
I20260618 23:22:11.828898 17479 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3: loading cluster ID for follower catalog manager: success
I20260618 23:22:11.829809 17479 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3: acquiring CA information for follower catalog manager: success
I20260618 23:22:11.830063 17479 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 02acda7e8cf940b0bacb99ee515743b3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260618 23:22:11.872993 17514 catalog_manager.cc:1259] Loaded cluster ID: f54a5990a9164171a14a8b1bcd13ef53
I20260618 23:22:11.873131 17514 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc: loading cluster ID for follower catalog manager: success
I20260618 23:22:11.874015 17514 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc: acquiring CA information for follower catalog manager: success
I20260618 23:22:11.874333 17514 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9463b28a9c6e4051976f66846979e2fc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260618 23:22:12.284088 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 17243
I20260618 23:22:12.290393 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 17318
I20260618 23:22:12.295648 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 17393
2026-06-18T23:22:12Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3193 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:22:12 dist-test-slave-r9ct krb5kdc[17533](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:22:12 dist-test-slave-r9ct krb5kdc[17533](info): set up 2 sockets
Jun 18 23:22:12 dist-test-slave-r9ct krb5kdc[17533](info): commencing operation
krb5kdc: starting...
W20260618 23:22:13.374934 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:22:13 dist-test-slave-r9ct krb5kdc[17533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824933, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:22:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:22:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:22:13.494669 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:37189
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:35557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:37189
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:22:13.574783 17546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:13.574971 17546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:13.574993 17546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:13.576031 17546 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:22:13.576062 17546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:13.576076 17546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:13.576089 17546 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:22:13.576102 17546 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:22:13.577428 17546 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:35557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:37189
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:37189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17546
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:13.577601 17546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:13.577752 17546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:13.582603 17551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:13.582647 17546 server_base.cc:1034] running on GCE node
W20260618 23:22:13.582623 17554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:13.582603 17552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:13.583151 17546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:13.583422 17546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:13.584617 17546 hybrid_clock.cc:648] HybridClock initialized: now 1781824933584612 us; error 37 us; skew 500 ppm
Jun 18 23:22:13 dist-test-slave-r9ct krb5kdc[17533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824933, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:13.587172 17546 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:22:13.587591 17546 webserver.cc:460] Webserver started at http://127.3.217.190:37603/ using document root <none> and password file <none>
I20260618 23:22:13.587828 17546 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:13.587896 17546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:13.588043 17546 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:22:13.589097 17546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "8bb79a940bfc43fb92048c3cacbd40a2"
format_stamp: "Formatted at 2026-06-18 23:22:13 on dist-test-slave-r9ct"
server_key: "a833b4677a955ec28cc68f0756a3cf97"
server_key_iv: "ba01f74d481e7fec45a793c12b47ebe1"
server_key_version: "encryptionkey@0"
I20260618 23:22:13.589459 17546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "8bb79a940bfc43fb92048c3cacbd40a2"
format_stamp: "Formatted at 2026-06-18 23:22:13 on dist-test-slave-r9ct"
server_key: "a833b4677a955ec28cc68f0756a3cf97"
server_key_iv: "ba01f74d481e7fec45a793c12b47ebe1"
server_key_version: "encryptionkey@0"
I20260618 23:22:13.590802 17546 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260618 23:22:13.591606 17561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:13.591782 17546 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:13.591878 17546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "8bb79a940bfc43fb92048c3cacbd40a2"
format_stamp: "Formatted at 2026-06-18 23:22:13 on dist-test-slave-r9ct"
server_key: "a833b4677a955ec28cc68f0756a3cf97"
server_key_iv: "ba01f74d481e7fec45a793c12b47ebe1"
server_key_version: "encryptionkey@0"
I20260618 23:22:13.591969 17546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:13.608527 17546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:13.610332 17546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:13.610492 17546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:13.614281 17546 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:37189
I20260618 23:22:13.614359 17613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:37189 every 8 connection(s)
I20260618 23:22:13.614686 17546 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:22:13.615504 17614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:13.617565 17614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2: Bootstrap starting.
I20260618 23:22:13.618080 17614 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2: Neither blocks nor log segments found. Creating new log.
I20260618 23:22:13.618317 17614 log.cc:824] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:13.618958 17614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2: No bootstrap required, opened a new log
I20260618 23:22:13.619920 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 17546
I20260618 23:22:13.620039 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:22:13.620251 3942 external_mini_cluster.cc:1428] Setting key 82199e4d50bf74e8a6eca52d7c89e5bd
I20260618 23:22:13.621024 17614 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bb79a940bfc43fb92048c3cacbd40a2" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37189 } }
I20260618 23:22:13.621177 17614 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:22:13.621215 17614 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bb79a940bfc43fb92048c3cacbd40a2, State: Initialized, Role: FOLLOWER
I20260618 23:22:13.621376 17614 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bb79a940bfc43fb92048c3cacbd40a2" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37189 } }
I20260618 23:22:13.621465 17614 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:22:13.621498 17614 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:22:13.621552 17614 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:22:13.622510 17614 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bb79a940bfc43fb92048c3cacbd40a2" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37189 } }
I20260618 23:22:13.622596 17614 leader_election.cc:302] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8bb79a940bfc43fb92048c3cacbd40a2; no voters:
I20260618 23:22:13.622772 17614 leader_election.cc:288] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:22:13.622797 17619 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:22:13.622964 17619 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2 [term 1 LEADER]: Becoming Leader. State: Replica: 8bb79a940bfc43fb92048c3cacbd40a2, State: Running, Role: LEADER
I20260618 23:22:13.623046 17614 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:22:13.623067 17619 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bb79a940bfc43fb92048c3cacbd40a2" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37189 } }
I20260618 23:22:13.623641 17620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8bb79a940bfc43fb92048c3cacbd40a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bb79a940bfc43fb92048c3cacbd40a2" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37189 } } }
I20260618 23:22:13.623634 17621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8bb79a940bfc43fb92048c3cacbd40a2. Latest consensus state: current_term: 1 leader_uuid: "8bb79a940bfc43fb92048c3cacbd40a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bb79a940bfc43fb92048c3cacbd40a2" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37189 } } }
I20260618 23:22:13.623791 17620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2 [sys.catalog]: This master's current role is: LEADER
I20260618 23:22:13.623806 17621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2 [sys.catalog]: This master's current role is: LEADER
I20260618 23:22:13.624236 17625 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:22:13.624763 17625 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:22:13.626443 17625 catalog_manager.cc:1347] Generated new cluster ID: f9b6c657ecc2497193edfc9db9d789cd
I20260618 23:22:13.626502 17625 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 18 23:22:13 dist-test-slave-r9ct krb5kdc[17533](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824933, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:13.632329 17618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:13.620724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52166 (local address 127.3.217.190:37189)
0618 23:22:13.620907 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:13.620914 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:13.620939 (+ 25us) server_negotiation.cc:407] Connection header received
0618 23:22:13.621028 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:13.621034 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:13.621073 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:13.621249 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:13.622039 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:13.623672 (+ 1633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:13.624772 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:13.625390 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:13.625509 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:13.628376 (+ 2867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:13.628380 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:13.628380 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:13.628391 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:13.630312 (+ 1921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:13.630779 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:13.630783 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:13.630783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:13.630900 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:13.631128 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:13.631129 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:13.631129 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:13.631407 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:13.631933 (+ 526us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:13.631996 (+ 63us) server_negotiation.cc:299] Negotiation successful
0618 23:22:13.632125 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":100,"threads_started":1}
I20260618 23:22:13.633270 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:22:13.633999 17625 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:22:13.634565 17625 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:22:13.640239 17625 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8bb79a940bfc43fb92048c3cacbd40a2: Generated new TSK 0
I20260618 23:22:13.640645 17625 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:22:13.687377 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 17546
2026-06-18T23:22:13Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1389 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:22:13 dist-test-slave-r9ct krb5kdc[17641](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:22:13 dist-test-slave-r9ct krb5kdc[17641](info): set up 2 sockets
Jun 18 23:22:13 dist-test-slave-r9ct krb5kdc[17641](info): commencing operation
krb5kdc: starting...
W20260618 23:22:14.739523 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.034s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:22:14 dist-test-slave-r9ct krb5kdc[17641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824934, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:22:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:22:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:22:14.865669 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:33165
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:34013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:33165
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:22:14.943789 17654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:14.944026 17654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:14.944064 17654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:14.945200 17654 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:22:14.945269 17654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:14.945292 17654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:14.945314 17654 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:22:14.945547 17654 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:22:14.948228 17654 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:34013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:33165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:33165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:14.948535 17654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:14.948781 17654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:14.954035 17662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:14.954101 17660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:14.954212 17654 server_base.cc:1034] running on GCE node
W20260618 23:22:14.954242 17659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:14.954602 17654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:14.954960 17654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:14.956140 17654 hybrid_clock.cc:648] HybridClock initialized: now 1781824934956120 us; error 36 us; skew 500 ppm
Jun 18 23:22:14 dist-test-slave-r9ct krb5kdc[17641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824934, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:14.959451 17654 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:22:14.960028 17654 webserver.cc:460] Webserver started at http://127.3.217.190:33271/ using document root <none> and password file <none>
I20260618 23:22:14.960265 17654 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:14.960333 17654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:14.960477 17654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:22:14.961771 17654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "8e427868420b4a688e93390f8d74d76f"
format_stamp: "Formatted at 2026-06-18 23:22:14 on dist-test-slave-r9ct"
server_key: "c9c409def84b9c9e5cd1873d26eb3880"
server_key_iv: "a927b738b91e6c228d26c1807b27f8c6"
server_key_version: "encryptionkey@0"
I20260618 23:22:14.962219 17654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "8e427868420b4a688e93390f8d74d76f"
format_stamp: "Formatted at 2026-06-18 23:22:14 on dist-test-slave-r9ct"
server_key: "c9c409def84b9c9e5cd1873d26eb3880"
server_key_iv: "a927b738b91e6c228d26c1807b27f8c6"
server_key_version: "encryptionkey@0"
I20260618 23:22:14.963795 17654 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:22:14.965003 17669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:14.965171 17654 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:14.965258 17654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "8e427868420b4a688e93390f8d74d76f"
format_stamp: "Formatted at 2026-06-18 23:22:14 on dist-test-slave-r9ct"
server_key: "c9c409def84b9c9e5cd1873d26eb3880"
server_key_iv: "a927b738b91e6c228d26c1807b27f8c6"
server_key_version: "encryptionkey@0"
I20260618 23:22:14.965317 17654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:14.989602 17654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:14.991780 17654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:14.991891 17654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:14.995879 17654 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:33165
I20260618 23:22:14.995932 17721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:33165 every 8 connection(s)
I20260618 23:22:14.996284 17654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:22:14.997644 17722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:15.000375 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 17654
I20260618 23:22:15.000382 17722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f: Bootstrap starting.
I20260618 23:22:15.000463 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:22:15.000666 3942 external_mini_cluster.cc:1428] Setting key e3ee23f4d261b6b476fbad170cc112aa
I20260618 23:22:15.001035 17722 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f: Neither blocks nor log segments found. Creating new log.
I20260618 23:22:15.001398 17722 log.cc:824] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:15.002465 17722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f: No bootstrap required, opened a new log
I20260618 23:22:15.004551 17722 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e427868420b4a688e93390f8d74d76f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33165 } }
I20260618 23:22:15.004730 17722 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:22:15.004779 17722 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e427868420b4a688e93390f8d74d76f, State: Initialized, Role: FOLLOWER
I20260618 23:22:15.004930 17722 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e427868420b4a688e93390f8d74d76f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33165 } }
I20260618 23:22:15.005020 17722 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:22:15.005064 17722 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:22:15.005111 17722 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:22:15.005649 17722 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e427868420b4a688e93390f8d74d76f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33165 } }
I20260618 23:22:15.005771 17722 leader_election.cc:302] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e427868420b4a688e93390f8d74d76f; no voters:
I20260618 23:22:15.005967 17722 leader_election.cc:288] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:22:15.005990 17727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:22:15.006153 17727 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 1 LEADER]: Becoming Leader. State: Replica: 8e427868420b4a688e93390f8d74d76f, State: Running, Role: LEADER
I20260618 23:22:15.006258 17722 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:22:15.006245 17727 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e427868420b4a688e93390f8d74d76f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33165 } }
I20260618 23:22:15.006562 17727 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e427868420b4a688e93390f8d74d76f. Latest consensus state: current_term: 1 leader_uuid: "8e427868420b4a688e93390f8d74d76f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e427868420b4a688e93390f8d74d76f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33165 } } }
I20260618 23:22:15.006767 17729 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e427868420b4a688e93390f8d74d76f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e427868420b4a688e93390f8d74d76f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33165 } } }
I20260618 23:22:15.006886 17729 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [sys.catalog]: This master's current role is: LEADER
I20260618 23:22:15.006639 17727 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [sys.catalog]: This master's current role is: LEADER
I20260618 23:22:15.008394 17731 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Jun 18 23:22:15 dist-test-slave-r9ct krb5kdc[17641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824934, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:15.008968 17731 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:22:15.011161 17731 catalog_manager.cc:1347] Generated new cluster ID: f14a3cc137cd4029b80621a3ab8096a3
I20260618 23:22:15.011263 17731 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:22:15.012921 17725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:15.001175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57022 (local address 127.3.217.190:33165)
0618 23:22:15.001393 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:15.001403 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:15.001435 (+ 32us) server_negotiation.cc:407] Connection header received
0618 23:22:15.002063 (+ 628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:15.002070 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:15.002117 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:15.002260 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:15.003157 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.004345 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.005446 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.005956 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.006424 (+ 468us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:15.009156 (+ 2732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:15.009160 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:15.009161 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:15.009172 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:15.011288 (+ 2116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:15.011690 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:15.011693 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:15.011693 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:15.011797 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:15.012033 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:15.012033 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:15.012034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:15.012309 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:15.012453 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:15.012586 (+ 133us) server_negotiation.cc:299] Negotiation successful
0618 23:22:15.012714 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":102,"threads_started":1}
I20260618 23:22:15.041356 17731 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:22:15.041997 17731 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:22:15.049630 17731 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f: Generated new TSK 0
I20260618 23:22:15.049846 17731 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.217.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
I20260618 23:22:15.078907 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:33165
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:34013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:22:15.164047 17748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:15.164258 17748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:15.164283 17748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:15.165397 17748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:15.165439 17748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:15.165465 17748 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:22:15.166962 17748 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:34013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:33165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:15.167176 17748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:15.167397 17748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:15.172254 17754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:15.172382 17748 server_base.cc:1034] running on GCE node
W20260618 23:22:15.172454 17753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:15.172485 17756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:15.172845 17748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:15.173128 17748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:15.174324 17748 hybrid_clock.cc:648] HybridClock initialized: now 1781824935174301 us; error 40 us; skew 500 ppm
Jun 18 23:22:15 dist-test-slave-r9ct krb5kdc[17641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824935, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:15.177340 17748 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:22:15.177814 17748 webserver.cc:460] Webserver started at http://127.3.217.129:36041/ using document root <none> and password file <none>
I20260618 23:22:15.178033 17748 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:15.178102 17748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:15.178256 17748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:22:15.179337 17748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "6954d5fbeb924beca053d78bfe642408"
format_stamp: "Formatted at 2026-06-18 23:22:15 on dist-test-slave-r9ct"
server_key: "7227cd136757c18f561401fb16814dc5"
server_key_iv: "35d71b80848f31aaee8f8d68251dab05"
server_key_version: "encryptionkey@0"
I20260618 23:22:15.179680 17748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "6954d5fbeb924beca053d78bfe642408"
format_stamp: "Formatted at 2026-06-18 23:22:15 on dist-test-slave-r9ct"
server_key: "7227cd136757c18f561401fb16814dc5"
server_key_iv: "35d71b80848f31aaee8f8d68251dab05"
server_key_version: "encryptionkey@0"
I20260618 23:22:15.180969 17748 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260618 23:22:15.181747 17763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:15.181948 17748 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:15.182053 17748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "6954d5fbeb924beca053d78bfe642408"
format_stamp: "Formatted at 2026-06-18 23:22:15 on dist-test-slave-r9ct"
server_key: "7227cd136757c18f561401fb16814dc5"
server_key_iv: "35d71b80848f31aaee8f8d68251dab05"
server_key_version: "encryptionkey@0"
I20260618 23:22:15.182176 17748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:15.197173 17748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:15.199520 17748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:15.199715 17748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:15.199952 17748 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:22:15.200317 17748 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:22:15.200376 17748 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:15.200416 17748 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:22:15.200443 17748 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:15.206501 17748 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:42863
I20260618 23:22:15.206600 17876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:42863 every 8 connection(s)
I20260618 23:22:15.206928 17748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
Jun 18 23:22:15 dist-test-slave-r9ct krb5kdc[17641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824935, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:15.214072 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 17748
I20260618 23:22:15.214210 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:22:15.214435 3942 external_mini_cluster.cc:1428] Setting key 580de7394d7deba57c3e2bd13cab67ef
I20260618 23:22:15.216688 17725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:15.207736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:37149 (local address 127.3.217.190:33165)
0618 23:22:15.207816 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:15.207819 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:15.208011 (+ 192us) server_negotiation.cc:407] Connection header received
0618 23:22:15.208534 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:15.208536 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:15.208548 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:15.208599 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:15.209627 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.210155 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.211159 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.211384 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.211468 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:15.213570 (+ 2102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:15.213571 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:15.213572 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:15.213579 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:15.215268 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:15.215675 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:15.215677 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:15.215677 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:15.215735 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:15.215996 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:15.215996 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:15.215997 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:15.216115 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:15.216189 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:15.216544 (+ 355us) server_negotiation.cc:299] Negotiation successful
0618 23:22:15.216626 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260618 23:22:15.216926 17879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:15.207699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.129:37149)
0618 23:22:15.207882 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:15.207929 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:15.208426 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:15.208665 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:15.208668 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:15.209343 (+ 675us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:15.209527 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:15.209531 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.210247 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.210248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:15.211065 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:15.211067 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.211478 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.211479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:15.211608 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:15.212081 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:15.212089 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:15.213466 (+ 1377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:15.215360 (+ 1894us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:15.215367 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:15.215369 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:15.215585 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:15.215810 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:15.215810 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:15.215811 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:15.215929 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:15.216189 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:15.216196 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:15.216365 (+ 169us) client_negotiation.cc:769] Sending connection context
0618 23:22:15.216488 (+ 123us) client_negotiation.cc:240] Negotiation successful
0618 23:22:15.216660 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":80,"threads_started":1}
I20260618 23:22:15.217620 17877 heartbeater.cc:347] Connected to a master server at 127.3.217.190:33165
I20260618 23:22:15.217725 17877 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:15.217896 17877 heartbeater.cc:511] Master 127.3.217.190:33165 requested a full tablet report, sending...
I20260618 23:22:15.218514 17686 ts_manager.cc:194] Registered new tserver with Master: 6954d5fbeb924beca053d78bfe642408 (127.3.217.129:42863)
I20260618 23:22:15.219583 17686 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:37149
WARNING: no policy specified for kudu/127.3.217.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
I20260618 23:22:15.242470 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:33165
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:34013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:22:15.325445 17882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:15.325636 17882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:15.325660 17882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:15.326860 17882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:15.326902 17882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:15.326928 17882 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:22:15.328342 17882 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:34013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:33165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17882
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:15.328578 17882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:15.328801 17882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:15.334147 17890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:15.334159 17888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:15.334159 17887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:15.334407 17882 server_base.cc:1034] running on GCE node
I20260618 23:22:15.334586 17882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:15.334854 17882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:15.336046 17882 hybrid_clock.cc:648] HybridClock initialized: now 1781824935336040 us; error 36 us; skew 500 ppm
Jun 18 23:22:15 dist-test-slave-r9ct krb5kdc[17641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824935, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:15.338547 17882 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:22:15.339157 17882 webserver.cc:460] Webserver started at http://127.3.217.130:37705/ using document root <none> and password file <none>
I20260618 23:22:15.339468 17882 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:15.339540 17882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:15.339694 17882 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:22:15.340796 17882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "e044e4babc31486a92110e28b2d3caf9"
format_stamp: "Formatted at 2026-06-18 23:22:15 on dist-test-slave-r9ct"
server_key: "ce1897ffc18768d1bcc05bbbeb317338"
server_key_iv: "f9b7ce42fdb3c1de4e20295da65f6c7d"
server_key_version: "encryptionkey@0"
I20260618 23:22:15.341187 17882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "e044e4babc31486a92110e28b2d3caf9"
format_stamp: "Formatted at 2026-06-18 23:22:15 on dist-test-slave-r9ct"
server_key: "ce1897ffc18768d1bcc05bbbeb317338"
server_key_iv: "f9b7ce42fdb3c1de4e20295da65f6c7d"
server_key_version: "encryptionkey@0"
I20260618 23:22:15.342617 17882 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260618 23:22:15.343525 17897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:15.343750 17882 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:15.343844 17882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "e044e4babc31486a92110e28b2d3caf9"
format_stamp: "Formatted at 2026-06-18 23:22:15 on dist-test-slave-r9ct"
server_key: "ce1897ffc18768d1bcc05bbbeb317338"
server_key_iv: "f9b7ce42fdb3c1de4e20295da65f6c7d"
server_key_version: "encryptionkey@0"
I20260618 23:22:15.343928 17882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:15.354012 17882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:15.356766 17882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:15.356931 17882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:15.357172 17882 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:22:15.357477 17882 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:22:15.357533 17882 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:15.357573 17882 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:22:15.357601 17882 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:15.364284 17882 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:41153
I20260618 23:22:15.364332 18010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:41153 every 8 connection(s)
I20260618 23:22:15.364646 17882 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:22:15.368525 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 17882
I20260618 23:22:15.368652 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:22:15.368863 3942 external_mini_cluster.cc:1428] Setting key e432bdd5ebad42fb96ea7191c11b5912
Jun 18 23:22:15 dist-test-slave-r9ct krb5kdc[17641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824935, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:15.376748 17725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:15.365638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:59663 (local address 127.3.217.190:33165)
0618 23:22:15.365733 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:15.365736 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:15.366140 (+ 404us) server_negotiation.cc:407] Connection header received
0618 23:22:15.366700 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:15.366701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:15.366796 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:15.366893 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:15.367958 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.368794 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.370256 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.370451 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.370570 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:15.373429 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:15.373431 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:15.373431 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:15.373439 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:15.375256 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:15.375740 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:15.375741 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:15.375741 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:15.375803 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:15.376055 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:15.376056 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:15.376056 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:15.376191 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:15.376271 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:15.376553 (+ 282us) server_negotiation.cc:299] Negotiation successful
0618 23:22:15.376642 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260618 23:22:15.376953 18013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:15.365721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.130:59663)
0618 23:22:15.365914 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:15.365974 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:15.366545 (+ 571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:15.366973 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:15.366976 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:15.367554 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:15.367786 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:15.367792 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.368953 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.368955 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:15.370154 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:15.370159 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.370601 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.370612 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:15.370832 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:15.371705 (+ 873us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:15.371717 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:15.373285 (+ 1568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:15.375379 (+ 2094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:15.375385 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:15.375387 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:15.375615 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:15.375876 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:15.375877 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:15.375878 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:15.375984 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:15.376261 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:15.376267 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:15.376424 (+ 157us) client_negotiation.cc:769] Sending connection context
0618 23:22:15.376532 (+ 108us) client_negotiation.cc:240] Negotiation successful
0618 23:22:15.376709 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":100,"threads_started":1}
I20260618 23:22:15.377563 18011 heartbeater.cc:347] Connected to a master server at 127.3.217.190:33165
I20260618 23:22:15.377684 18011 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:15.377884 18011 heartbeater.cc:511] Master 127.3.217.190:33165 requested a full tablet report, sending...
I20260618 23:22:15.378366 17686 ts_manager.cc:194] Registered new tserver with Master: e044e4babc31486a92110e28b2d3caf9 (127.3.217.130:41153)
I20260618 23:22:15.378826 17686 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:59663
WARNING: no policy specified for kudu/127.3.217.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
I20260618 23:22:15.405344 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:33165
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:34013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:22:15.492128 18016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:15.492378 18016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:15.492403 18016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:15.493462 18016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:15.493505 18016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:15.493531 18016 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:22:15.495167 18016 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:34013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:33165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:15.495378 18016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:15.495551 18016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:15.502060 18022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:15.502039 18021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:15.502043 18024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:15.502394 18016 server_base.cc:1034] running on GCE node
I20260618 23:22:15.502610 18016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:15.502907 18016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:15.504107 18016 hybrid_clock.cc:648] HybridClock initialized: now 1781824935504057 us; error 67 us; skew 500 ppm
Jun 18 23:22:15 dist-test-slave-r9ct krb5kdc[17641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824935, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:15.512671 18016 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:22:15.513166 18016 webserver.cc:460] Webserver started at http://127.3.217.131:36685/ using document root <none> and password file <none>
I20260618 23:22:15.513422 18016 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:15.513491 18016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:15.513643 18016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:22:15.514695 18016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "61a60489bf8f41edba6e3ab271882e42"
format_stamp: "Formatted at 2026-06-18 23:22:15 on dist-test-slave-r9ct"
server_key: "b4dbbb63d7cfb25626b1baacc7d84d7e"
server_key_iv: "488982cddb1a8ea0c1b0c08f7cb52090"
server_key_version: "encryptionkey@0"
I20260618 23:22:15.515117 18016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "61a60489bf8f41edba6e3ab271882e42"
format_stamp: "Formatted at 2026-06-18 23:22:15 on dist-test-slave-r9ct"
server_key: "b4dbbb63d7cfb25626b1baacc7d84d7e"
server_key_iv: "488982cddb1a8ea0c1b0c08f7cb52090"
server_key_version: "encryptionkey@0"
I20260618 23:22:15.516492 18016 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:15.517457 18031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:15.517922 18016 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:15.518162 18016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "61a60489bf8f41edba6e3ab271882e42"
format_stamp: "Formatted at 2026-06-18 23:22:15 on dist-test-slave-r9ct"
server_key: "b4dbbb63d7cfb25626b1baacc7d84d7e"
server_key_iv: "488982cddb1a8ea0c1b0c08f7cb52090"
server_key_version: "encryptionkey@0"
I20260618 23:22:15.518280 18016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:15.530646 18016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:15.532994 18016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:15.533166 18016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:15.533402 18016 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:22:15.533716 18016 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:22:15.533773 18016 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:15.533816 18016 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:22:15.533844 18016 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:15.542241 18016 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:41633
I20260618 23:22:15.542280 18144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:41633 every 8 connection(s)
I20260618 23:22:15.542814 18016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
Jun 18 23:22:15 dist-test-slave-r9ct krb5kdc[17641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824935, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:15.552112 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 18016
I20260618 23:22:15.552233 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:22:15.552450 3942 external_mini_cluster.cc:1428] Setting key 9ef19149fde5987c0c9b9086edf26754
I20260618 23:22:15.555173 17725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:15.544033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:57957 (local address 127.3.217.190:33165)
0618 23:22:15.544090 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:15.544091 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:15.544347 (+ 256us) server_negotiation.cc:407] Connection header received
0618 23:22:15.544935 (+ 588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:15.544936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:15.544951 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:15.545030 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:15.546374 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.547157 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.548421 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.548925 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.549002 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:15.551803 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:15.551805 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:15.551805 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:15.551813 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:15.553609 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:15.554023 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:15.554024 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:15.554024 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:15.554116 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:15.554499 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:15.554500 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:15.554500 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:15.554627 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:15.554686 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:15.555040 (+ 354us) server_negotiation.cc:299] Negotiation successful
0618 23:22:15.555109 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260618 23:22:15.555331 18147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:15.543943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.131:57957)
0618 23:22:15.544182 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:15.544221 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:15.544727 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:15.545134 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:15.545138 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:15.546005 (+ 867us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:15.546236 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:15.546240 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.547300 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.547301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:15.548273 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:15.548275 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.549097 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.549098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:15.549262 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:15.550172 (+ 910us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:15.550186 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:15.551675 (+ 1489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:15.553671 (+ 1996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:15.553676 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:15.553679 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:15.553911 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:15.554271 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:15.554272 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:15.554272 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:15.554399 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:15.554764 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:15.554776 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:15.554893 (+ 117us) client_negotiation.cc:769] Sending connection context
0618 23:22:15.554984 (+ 91us) client_negotiation.cc:240] Negotiation successful
0618 23:22:15.555121 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":89,"threads_started":1}
I20260618 23:22:15.555920 18145 heartbeater.cc:347] Connected to a master server at 127.3.217.190:33165
I20260618 23:22:15.556211 18145 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:15.556442 18145 heartbeater.cc:511] Master 127.3.217.190:33165 requested a full tablet report, sending...
I20260618 23:22:15.556788 17686 ts_manager.cc:194] Registered new tserver with Master: 61a60489bf8f41edba6e3ab271882e42 (127.3.217.131:41633)
I20260618 23:22:15.557152 17686 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:57957
I20260618 23:22:15.565212 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260618 23:22:15.573326 17725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:15.566699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57026 (local address 127.3.217.190:33165)
0618 23:22:15.566816 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:15.566818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:15.566921 (+ 103us) server_negotiation.cc:407] Connection header received
0618 23:22:15.567003 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:15.567004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:15.567014 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:15.567059 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:15.567645 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.568221 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.568954 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.569217 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.569284 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:15.570619 (+ 1335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:15.570621 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:15.570621 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:15.570627 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:15.572020 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:15.572476 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:15.572477 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:15.572477 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:15.572532 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:15.572808 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:15.572809 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:15.572809 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:15.572952 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:15.573030 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:15.573198 (+ 168us) server_negotiation.cc:299] Negotiation successful
0618 23:22:15.573264 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260618 23:22:15.575210 17686 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57026:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:22:15.576754 17686 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:22:15.583788 18156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:15.579274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:41633 (local address 127.0.0.1:50552)
0618 23:22:15.579432 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:15.579471 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:15.579534 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:15.579942 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:15.579945 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:15.579947 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:15.580016 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:15.580017 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.581294 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.581296 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:15.582555 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:15.582557 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.583503 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.583504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:15.583580 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:15.583593 (+ 13us) client_negotiation.cc:769] Sending connection context
0618 23:22:15.583666 (+ 73us) client_negotiation.cc:240] Negotiation successful
0618 23:22:15.583712 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":40,"thread_start_us":56,"threads_started":1}
I20260618 23:22:15.583828 18159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:15.579367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50552 (local address 127.3.217.131:41633)
0618 23:22:15.579741 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:15.579744 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:15.579769 (+ 25us) server_negotiation.cc:407] Connection header received
0618 23:22:15.579801 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:15.579803 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:15.579815 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:15.579895 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:15.580092 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.581158 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.582660 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.583417 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.583499 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:15.583555 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:15.583703 (+ 148us) server_negotiation.cc:299] Negotiation successful
0618 23:22:15.583746 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":89,"threads_started":1}
I20260618 23:22:15.584246 18157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:15.579301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:41153 (local address 127.0.0.1:53484)
0618 23:22:15.580159 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:15.580168 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:15.580212 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:15.580460 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:15.580462 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:15.580467 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:15.580573 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:15.580576 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.581660 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.581661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:15.582826 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:15.582829 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.583976 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.583977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:15.584042 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:15.584047 (+ 5us) client_negotiation.cc:769] Sending connection context
0618 23:22:15.584133 (+ 86us) client_negotiation.cc:240] Negotiation successful
0618 23:22:15.584173 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":842,"thread_start_us":74,"threads_started":1}
I20260618 23:22:15.584631 18079 tablet_service.cc:1467] Processing CreateTablet for tablet 8b738fc081524866a78087aa4631d921 (DEFAULT_TABLE table=test-table [id=3b8bccc27aae43d98e4e5910eb842c03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:22:15.584925 18158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:15.579281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:42863 (local address 127.0.0.1:40064)
0618 23:22:15.580001 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:15.580011 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:15.580084 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:15.580785 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:15.580786 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:15.580788 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:15.580832 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:15.580833 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.582324 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.582324 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:15.583239 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:15.583241 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.584705 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.584705 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:15.584768 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:15.584772 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:22:15.584823 (+ 51us) client_negotiation.cc:240] Negotiation successful
0618 23:22:15.584861 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":700,"thread_start_us":84,"threads_started":1}
I20260618 23:22:15.585013 18160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:15.579516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40064 (local address 127.3.217.129:42863)
0618 23:22:15.579677 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:15.579682 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:15.580411 (+ 729us) server_negotiation.cc:407] Connection header received
0618 23:22:15.580488 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:15.580491 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:15.580513 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:15.580659 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:15.580923 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.582198 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.583339 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.584606 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.584702 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:15.584755 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:15.584843 (+ 88us) server_negotiation.cc:299] Negotiation successful
0618 23:22:15.584919 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":97,"threads_started":1}
I20260618 23:22:15.585079 18079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b738fc081524866a78087aa4631d921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:15.585521 17811 tablet_service.cc:1467] Processing CreateTablet for tablet 8b738fc081524866a78087aa4631d921 (DEFAULT_TABLE table=test-table [id=3b8bccc27aae43d98e4e5910eb842c03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:22:15.585844 17811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b738fc081524866a78087aa4631d921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:15.586951 18161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:15.579566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53484 (local address 127.3.217.130:41153)
0618 23:22:15.579729 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:15.579733 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:15.580237 (+ 504us) server_negotiation.cc:407] Connection header received
0618 23:22:15.580282 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:15.580284 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:15.580306 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:15.580387 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:15.580666 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.581562 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.582917 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.583604 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.583701 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:15.583752 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:15.586818 (+ 3066us) server_negotiation.cc:299] Negotiation successful
0618 23:22:15.586868 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":89,"threads_started":1}
I20260618 23:22:15.587883 17944 tablet_service.cc:1467] Processing CreateTablet for tablet 8b738fc081524866a78087aa4631d921 (DEFAULT_TABLE table=test-table [id=3b8bccc27aae43d98e4e5910eb842c03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:22:15.588255 17944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b738fc081524866a78087aa4631d921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:15.588634 18162 tablet_bootstrap.cc:492] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408: Bootstrap starting.
I20260618 23:22:15.588814 18163 tablet_bootstrap.cc:492] T 8b738fc081524866a78087aa4631d921 P 61a60489bf8f41edba6e3ab271882e42: Bootstrap starting.
I20260618 23:22:15.589178 18162 tablet_bootstrap.cc:654] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408: Neither blocks nor log segments found. Creating new log.
I20260618 23:22:15.589428 18163 tablet_bootstrap.cc:654] T 8b738fc081524866a78087aa4631d921 P 61a60489bf8f41edba6e3ab271882e42: Neither blocks nor log segments found. Creating new log.
I20260618 23:22:15.589567 18162 log.cc:824] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:15.589978 18163 log.cc:824] T 8b738fc081524866a78087aa4631d921 P 61a60489bf8f41edba6e3ab271882e42: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:15.590219 18162 tablet_bootstrap.cc:492] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408: No bootstrap required, opened a new log
I20260618 23:22:15.590277 18162 ts_tablet_manager.cc:1397] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:22:15.590757 18163 tablet_bootstrap.cc:492] T 8b738fc081524866a78087aa4631d921 P 61a60489bf8f41edba6e3ab271882e42: No bootstrap required, opened a new log
I20260618 23:22:15.590814 18163 ts_tablet_manager.cc:1397] T 8b738fc081524866a78087aa4631d921 P 61a60489bf8f41edba6e3ab271882e42: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:22:15.591645 18166 tablet_bootstrap.cc:492] T 8b738fc081524866a78087aa4631d921 P e044e4babc31486a92110e28b2d3caf9: Bootstrap starting.
I20260618 23:22:15.592058 18162 raft_consensus.cc:348] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:15.592265 18162 raft_consensus.cc:374] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:22:15.592303 18162 raft_consensus.cc:729] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6954d5fbeb924beca053d78bfe642408, State: Initialized, Role: FOLLOWER
I20260618 23:22:15.592476 18166 tablet_bootstrap.cc:654] T 8b738fc081524866a78087aa4631d921 P e044e4babc31486a92110e28b2d3caf9: Neither blocks nor log segments found. Creating new log.
I20260618 23:22:15.592444 18162 consensus_queue.cc:260] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:15.592752 18162 ts_tablet_manager.cc:1428] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260618 23:22:15.592778 17877 heartbeater.cc:503] Master 127.3.217.190:33165 was elected leader, sending a full tablet report...
I20260618 23:22:15.592989 18163 raft_consensus.cc:348] T 8b738fc081524866a78087aa4631d921 P 61a60489bf8f41edba6e3ab271882e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:15.593163 18163 raft_consensus.cc:374] T 8b738fc081524866a78087aa4631d921 P 61a60489bf8f41edba6e3ab271882e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:22:15.593200 18163 raft_consensus.cc:729] T 8b738fc081524866a78087aa4631d921 P 61a60489bf8f41edba6e3ab271882e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61a60489bf8f41edba6e3ab271882e42, State: Initialized, Role: FOLLOWER
I20260618 23:22:15.593258 18166 log.cc:824] T 8b738fc081524866a78087aa4631d921 P e044e4babc31486a92110e28b2d3caf9: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:15.593297 18163 consensus_queue.cc:260] T 8b738fc081524866a78087aa4631d921 P 61a60489bf8f41edba6e3ab271882e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:15.593564 18163 ts_tablet_manager.cc:1428] T 8b738fc081524866a78087aa4631d921 P 61a60489bf8f41edba6e3ab271882e42: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260618 23:22:15.593900 18145 heartbeater.cc:503] Master 127.3.217.190:33165 was elected leader, sending a full tablet report...
I20260618 23:22:15.594102 18166 tablet_bootstrap.cc:492] T 8b738fc081524866a78087aa4631d921 P e044e4babc31486a92110e28b2d3caf9: No bootstrap required, opened a new log
I20260618 23:22:15.594157 18166 ts_tablet_manager.cc:1397] T 8b738fc081524866a78087aa4631d921 P e044e4babc31486a92110e28b2d3caf9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260618 23:22:15.595727 18166 raft_consensus.cc:348] T 8b738fc081524866a78087aa4631d921 P e044e4babc31486a92110e28b2d3caf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:15.595847 18166 raft_consensus.cc:374] T 8b738fc081524866a78087aa4631d921 P e044e4babc31486a92110e28b2d3caf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:22:15.595870 18166 raft_consensus.cc:729] T 8b738fc081524866a78087aa4631d921 P e044e4babc31486a92110e28b2d3caf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e044e4babc31486a92110e28b2d3caf9, State: Initialized, Role: FOLLOWER
I20260618 23:22:15.595973 18166 consensus_queue.cc:260] T 8b738fc081524866a78087aa4631d921 P e044e4babc31486a92110e28b2d3caf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:15.596253 18166 ts_tablet_manager.cc:1428] T 8b738fc081524866a78087aa4631d921 P e044e4babc31486a92110e28b2d3caf9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:22:15.596309 18011 heartbeater.cc:503] Master 127.3.217.190:33165 was elected leader, sending a full tablet report...
W20260618 23:22:15.615463 18012 tablet.cc:2369] T 8b738fc081524866a78087aa4631d921 P e044e4babc31486a92110e28b2d3caf9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260618 23:22:15.707706 17878 tablet.cc:2369] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 23:22:15.791414 18167 raft_consensus.cc:482] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:22:15.791657 18167 raft_consensus.cc:504] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:15.792151 18167 leader_election.cc:288] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e044e4babc31486a92110e28b2d3caf9 (127.3.217.130:41153), 61a60489bf8f41edba6e3ab271882e42 (127.3.217.131:41633)
W20260618 23:22:15.793514 18146 tablet.cc:2369] T 8b738fc081524866a78087aa4631d921 P 61a60489bf8f41edba6e3ab271882e42: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 23:22:15.795734 18161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:15.792523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:35653 (local address 127.3.217.130:41153)
0618 23:22:15.792609 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:15.792613 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:15.792712 (+ 99us) server_negotiation.cc:407] Connection header received
0618 23:22:15.793011 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:15.793012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:15.793023 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:15.793170 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:15.793358 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.793942 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.794965 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.795346 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.795449 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:15.795459 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:15.795620 (+ 161us) server_negotiation.cc:299] Negotiation successful
0618 23:22:15.795655 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260618 23:22:15.795759 18159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:15.792667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:53259 (local address 127.3.217.131:41633)
0618 23:22:15.792731 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:15.792733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:15.792854 (+ 121us) server_negotiation.cc:407] Connection header received
0618 23:22:15.792933 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:15.792935 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:15.792947 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:15.793039 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:15.793217 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.793834 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.794948 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.795373 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.795477 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:15.795486 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:15.795643 (+ 157us) server_negotiation.cc:299] Negotiation successful
0618 23:22:15.795680 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260618 23:22:15.795815 18171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:15.792404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:41153 (local address 127.3.217.129:35653)
0618 23:22:15.792618 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:15.792633 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:15.792755 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:15.793183 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:15.793184 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:15.793186 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:15.793275 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:15.793277 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.794033 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.794034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:15.794877 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:15.794879 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.795449 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.795450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:15.795520 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:15.795530 (+ 10us) client_negotiation.cc:769] Sending connection context
0618 23:22:15.795611 (+ 81us) client_negotiation.cc:240] Negotiation successful
0618 23:22:15.795654 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":122,"threads_started":1}
I20260618 23:22:15.795976 18172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:15.792572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:41633 (local address 127.3.217.129:53259)
0618 23:22:15.792731 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:15.792759 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:15.792860 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:15.793047 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:15.793048 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:15.793049 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:15.793136 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:15.793138 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.793924 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.793925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:15.794843 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:15.794845 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.795478 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.795479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:15.795559 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:15.795563 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:22:15.795636 (+ 73us) client_negotiation.cc:240] Negotiation successful
0618 23:22:15.795680 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":90,"threads_started":1}
I20260618 23:22:15.796394 17965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b738fc081524866a78087aa4631d921" candidate_uuid: "6954d5fbeb924beca053d78bfe642408" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e044e4babc31486a92110e28b2d3caf9" is_pre_election: true
I20260618 23:22:15.796563 17965 raft_consensus.cc:2454] T 8b738fc081524866a78087aa4631d921 P e044e4babc31486a92110e28b2d3caf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6954d5fbeb924beca053d78bfe642408 in term 0.
I20260618 23:22:15.796624 18099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b738fc081524866a78087aa4631d921" candidate_uuid: "6954d5fbeb924beca053d78bfe642408" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61a60489bf8f41edba6e3ab271882e42" is_pre_election: true
I20260618 23:22:15.796794 18099 raft_consensus.cc:2454] T 8b738fc081524866a78087aa4631d921 P 61a60489bf8f41edba6e3ab271882e42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6954d5fbeb924beca053d78bfe642408 in term 0.
I20260618 23:22:15.796828 17766 leader_election.cc:302] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6954d5fbeb924beca053d78bfe642408, e044e4babc31486a92110e28b2d3caf9; no voters:
I20260618 23:22:15.797065 18167 raft_consensus.cc:2781] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:22:15.797117 18167 raft_consensus.cc:482] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:22:15.797133 18167 raft_consensus.cc:3037] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:22:15.797930 18167 raft_consensus.cc:504] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:15.798144 18167 leader_election.cc:288] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [CANDIDATE]: Term 1 election: Requested vote from peers e044e4babc31486a92110e28b2d3caf9 (127.3.217.130:41153), 61a60489bf8f41edba6e3ab271882e42 (127.3.217.131:41633)
I20260618 23:22:15.798213 17965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b738fc081524866a78087aa4631d921" candidate_uuid: "6954d5fbeb924beca053d78bfe642408" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e044e4babc31486a92110e28b2d3caf9"
I20260618 23:22:15.798249 18099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b738fc081524866a78087aa4631d921" candidate_uuid: "6954d5fbeb924beca053d78bfe642408" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61a60489bf8f41edba6e3ab271882e42"
I20260618 23:22:15.798291 17965 raft_consensus.cc:3037] T 8b738fc081524866a78087aa4631d921 P e044e4babc31486a92110e28b2d3caf9 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:22:15.798342 18099 raft_consensus.cc:3037] T 8b738fc081524866a78087aa4631d921 P 61a60489bf8f41edba6e3ab271882e42 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:22:15.799072 17965 raft_consensus.cc:2454] T 8b738fc081524866a78087aa4631d921 P e044e4babc31486a92110e28b2d3caf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6954d5fbeb924beca053d78bfe642408 in term 1.
I20260618 23:22:15.799156 18099 raft_consensus.cc:2454] T 8b738fc081524866a78087aa4631d921 P 61a60489bf8f41edba6e3ab271882e42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6954d5fbeb924beca053d78bfe642408 in term 1.
I20260618 23:22:15.799443 17766 leader_election.cc:302] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6954d5fbeb924beca053d78bfe642408, e044e4babc31486a92110e28b2d3caf9; no voters:
I20260618 23:22:15.799623 18167 raft_consensus.cc:2781] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:22:15.799845 18167 raft_consensus.cc:686] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [term 1 LEADER]: Becoming Leader. State: Replica: 6954d5fbeb924beca053d78bfe642408, State: Running, Role: LEADER
I20260618 23:22:15.799923 18167 consensus_queue.cc:237] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:15.800724 17686 catalog_manager.cc:5495] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6954d5fbeb924beca053d78bfe642408 (127.3.217.129). New cstate: current_term: 1 leader_uuid: "6954d5fbeb924beca053d78bfe642408" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } health_report { overall_health: HEALTHY } } }
I20260618 23:22:15.813580 18160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:15.810828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40078 (local address 127.3.217.129:42863)
0618 23:22:15.810894 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:15.810896 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:15.810906 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:22:15.810942 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:15.810943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:15.810969 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:15.811119 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:22:15.811422 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.811920 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.812812 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:15.812994 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:15.813057 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:15.813232 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:22:15.813346 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:22:15.813423 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:15.813502 (+ 79us) server_negotiation.cc:299] Negotiation successful
0618 23:22:15.813522 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260618 23:22:15.815943 18099 raft_consensus.cc:1261] T 8b738fc081524866a78087aa4631d921 P 61a60489bf8f41edba6e3ab271882e42 [term 1 FOLLOWER]: Refusing update from remote peer 6954d5fbeb924beca053d78bfe642408: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:22:15.815968 17965 raft_consensus.cc:1261] T 8b738fc081524866a78087aa4631d921 P e044e4babc31486a92110e28b2d3caf9 [term 1 FOLLOWER]: Refusing update from remote peer 6954d5fbeb924beca053d78bfe642408: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:22:15.816443 18173 consensus_queue.cc:1035] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:22:15.816582 18167 consensus_queue.cc:1035] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:22:15.818933 18176 mvcc.cc:205] Tried to move back new op lower bound from 7298354937097920512 to 7298354937037021184. Current Snapshot: MvccSnapshot[applied={T|T < 7298354937097920512}]
I20260618 23:22:15.821460 17686 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:22:15.821569 17686 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:22:15.822727 17686 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f: Sending DeleteTablet for 3 replicas of tablet 8b738fc081524866a78087aa4631d921
I20260618 23:22:15.823086 17811 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b738fc081524866a78087aa4631d921 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:22:15 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:40064
I20260618 23:22:15.823084 17944 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b738fc081524866a78087aa4631d921 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:22:15 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:53484
I20260618 23:22:15.823084 18079 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b738fc081524866a78087aa4631d921 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:22:15 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:50552
I20260618 23:22:15.823376 18187 tablet_replica.cc:330] T 8b738fc081524866a78087aa4631d921 P e044e4babc31486a92110e28b2d3caf9: stopping tablet replica
I20260618 23:22:15.823376 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 17748
I20260618 23:22:15.823393 18186 tablet_replica.cc:330] T 8b738fc081524866a78087aa4631d921 P 61a60489bf8f41edba6e3ab271882e42: stopping tablet replica
I20260618 23:22:15.824028 18186 raft_consensus.cc:2229] T 8b738fc081524866a78087aa4631d921 P 61a60489bf8f41edba6e3ab271882e42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:22:15.824116 18186 raft_consensus.cc:2258] T 8b738fc081524866a78087aa4631d921 P 61a60489bf8f41edba6e3ab271882e42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:22:15.824520 18186 ts_tablet_manager.cc:1905] T 8b738fc081524866a78087aa4631d921 P 61a60489bf8f41edba6e3ab271882e42: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:22:15.824669 18187 raft_consensus.cc:2229] T 8b738fc081524866a78087aa4631d921 P e044e4babc31486a92110e28b2d3caf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:22:15.824783 18187 raft_consensus.cc:2258] T 8b738fc081524866a78087aa4631d921 P e044e4babc31486a92110e28b2d3caf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:22:15.825218 18187 ts_tablet_manager.cc:1905] T 8b738fc081524866a78087aa4631d921 P e044e4babc31486a92110e28b2d3caf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:22:15.826053 18186 ts_tablet_manager.cc:1918] T 8b738fc081524866a78087aa4631d921 P 61a60489bf8f41edba6e3ab271882e42: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:22:15.826126 18186 log.cc:1196] T 8b738fc081524866a78087aa4631d921 P 61a60489bf8f41edba6e3ab271882e42: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/8b738fc081524866a78087aa4631d921
I20260618 23:22:15.826344 18186 ts_tablet_manager.cc:1939] T 8b738fc081524866a78087aa4631d921 P 61a60489bf8f41edba6e3ab271882e42: Deleting consensus metadata
I20260618 23:22:15.826694 17671 catalog_manager.cc:4841] TS 61a60489bf8f41edba6e3ab271882e42 (127.3.217.131:41633): tablet 8b738fc081524866a78087aa4631d921 (table test-table [id=3b8bccc27aae43d98e4e5910eb842c03]) successfully deleted
I20260618 23:22:15.827147 18187 ts_tablet_manager.cc:1918] T 8b738fc081524866a78087aa4631d921 P e044e4babc31486a92110e28b2d3caf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:22:15.827225 18187 log.cc:1196] T 8b738fc081524866a78087aa4631d921 P e044e4babc31486a92110e28b2d3caf9: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/8b738fc081524866a78087aa4631d921
I20260618 23:22:15.827491 18187 ts_tablet_manager.cc:1939] T 8b738fc081524866a78087aa4631d921 P e044e4babc31486a92110e28b2d3caf9: Deleting consensus metadata
I20260618 23:22:15.828061 17672 catalog_manager.cc:4841] TS e044e4babc31486a92110e28b2d3caf9 (127.3.217.130:41153): tablet 8b738fc081524866a78087aa4631d921 (table test-table [id=3b8bccc27aae43d98e4e5910eb842c03]) successfully deleted
W20260618 23:22:15.829926 17673 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.217.129:42863 (error 108)
I20260618 23:22:15.830286 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 17882
I20260618 23:22:15.830476 18158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:15.830318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:42863 (local address 127.0.0.1:40080)
0618 23:22:15.830381 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:15.830418 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.129:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260618 23:22:15.830685 17673 catalog_manager.cc:4584] TS 6954d5fbeb924beca053d78bfe642408 (127.3.217.129:42863): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8b738fc081524866a78087aa4631d921: Network error: Client connection negotiation failed: client connection to 127.3.217.129:42863: connect: Connection refused (error 111)
I20260618 23:22:15.837970 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 18016
I20260618 23:22:15.843389 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 17654
I20260618 23:22:15.848894 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:33165
--webserver_interface=127.3.217.190
--webserver_port=33271
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:34013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:33165
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:22:15.934224 18190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:15.934458 18190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:15.934494 18190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:15.935717 18190 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:22:15.935787 18190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:15.935822 18190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:15.935850 18190 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:22:15.935876 18190 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:22:15.937302 18190 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:34013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:33165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:33165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=33271
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:15.937572 18190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:15.937791 18190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:15.947537 18197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:15.947667 18199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:15.947499 18196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:15.947989 18190 server_base.cc:1034] running on GCE node
I20260618 23:22:15.948308 18190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:15.948642 18190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:15.950002 18190 hybrid_clock.cc:648] HybridClock initialized: now 1781824935949973 us; error 36 us; skew 500 ppm
Jun 18 23:22:15 dist-test-slave-r9ct krb5kdc[17641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824935, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:15.953431 18190 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:22:15.954035 18190 webserver.cc:460] Webserver started at http://127.3.217.190:33271/ using document root <none> and password file <none>
I20260618 23:22:15.954329 18190 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:15.954427 18190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:15.956111 18190 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:15.957110 18206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:15.957445 18190 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:15.957576 18190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "8e427868420b4a688e93390f8d74d76f"
format_stamp: "Formatted at 2026-06-18 23:22:14 on dist-test-slave-r9ct"
server_key: "c9c409def84b9c9e5cd1873d26eb3880"
server_key_iv: "a927b738b91e6c228d26c1807b27f8c6"
server_key_version: "encryptionkey@0"
I20260618 23:22:15.958058 18190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:15.990808 18190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:15.993064 18190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:15.993237 18190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:15.997516 18190 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:33165
I20260618 23:22:15.997548 18258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:33165 every 8 connection(s)
I20260618 23:22:15.997937 18190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:22:15.999615 18259 sys_catalog.cc:263] Verifying existing consensus state
I20260618 23:22:16.000214 18259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f: Bootstrap starting.
I20260618 23:22:16.005782 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 18190
I20260618 23:22:16.006152 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:42863
--local_ip_for_outbound_sockets=127.3.217.129
--tserver_master_addrs=127.3.217.190:33165
--webserver_port=36041
--webserver_interface=127.3.217.129
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:34013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260618 23:22:16.009276 18259 log.cc:824] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:16.011642 18259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260618 23:22:16.012005 18259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f: Bootstrap complete.
I20260618 23:22:16.014492 18259 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e427868420b4a688e93390f8d74d76f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33165 } }
I20260618 23:22:16.014778 18259 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e427868420b4a688e93390f8d74d76f, State: Initialized, Role: FOLLOWER
I20260618 23:22:16.015008 18259 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e427868420b4a688e93390f8d74d76f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33165 } }
I20260618 23:22:16.015092 18259 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:22:16.015126 18259 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:22:16.015153 18259 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 1 FOLLOWER]: Advancing to term 2
I20260618 23:22:16.016207 18259 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e427868420b4a688e93390f8d74d76f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33165 } }
I20260618 23:22:16.016292 18259 leader_election.cc:302] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e427868420b4a688e93390f8d74d76f; no voters:
I20260618 23:22:16.016460 18259 leader_election.cc:288] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260618 23:22:16.016508 18263 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 2 FOLLOWER]: Leader election won for term 2
I20260618 23:22:16.016633 18263 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 2 LEADER]: Becoming Leader. State: Replica: 8e427868420b4a688e93390f8d74d76f, State: Running, Role: LEADER
I20260618 23:22:16.016728 18259 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:22:16.016722 18263 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e427868420b4a688e93390f8d74d76f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33165 } }
I20260618 23:22:16.017115 18263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e427868420b4a688e93390f8d74d76f. Latest consensus state: current_term: 2 leader_uuid: "8e427868420b4a688e93390f8d74d76f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e427868420b4a688e93390f8d74d76f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33165 } } }
I20260618 23:22:16.017190 18263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [sys.catalog]: This master's current role is: LEADER
I20260618 23:22:16.017333 18264 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "8e427868420b4a688e93390f8d74d76f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e427868420b4a688e93390f8d74d76f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33165 } } }
I20260618 23:22:16.017405 18264 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [sys.catalog]: This master's current role is: LEADER
I20260618 23:22:16.017670 18267 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:22:16.018468 18267 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:22:16.018565 18267 catalog_manager.cc:1259] Loaded cluster ID: f14a3cc137cd4029b80621a3ab8096a3
I20260618 23:22:16.018594 18267 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:22:16.018988 18267 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260618 23:22:16.024076 18267 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260618 23:22:16.027177 18267 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:22:16.027391 18267 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f: Loaded TSK: 0
I20260618 23:22:16.027598 18267 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260618 23:22:16.093153 18261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:16.093350 18261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:16.093374 18261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:16.094511 18261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:16.094548 18261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:16.094574 18261 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:22:16.095978 18261 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:34013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:42863
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=36041
--tserver_master_addrs=127.3.217.190:33165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18261
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:16.096199 18261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:16.096448 18261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:16.102495 18287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:16.102689 18261 server_base.cc:1034] running on GCE node
W20260618 23:22:16.102466 18286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:16.102814 18289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:16.103049 18261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:16.103360 18261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:16.104528 18261 hybrid_clock.cc:648] HybridClock initialized: now 1781824936104507 us; error 38 us; skew 500 ppm
Jun 18 23:22:16 dist-test-slave-r9ct krb5kdc[17641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824936, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:16.107191 18261 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:22:16.107630 18261 webserver.cc:460] Webserver started at http://127.3.217.129:36041/ using document root <none> and password file <none>
I20260618 23:22:16.107856 18261 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:16.107939 18261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:16.109368 18261 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:22:16.110116 18296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:16.110260 18261 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260618 23:22:16.110360 18261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "6954d5fbeb924beca053d78bfe642408"
format_stamp: "Formatted at 2026-06-18 23:22:15 on dist-test-slave-r9ct"
server_key: "7227cd136757c18f561401fb16814dc5"
server_key_iv: "35d71b80848f31aaee8f8d68251dab05"
server_key_version: "encryptionkey@0"
I20260618 23:22:16.110692 18261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:16.118508 18261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:16.120946 18261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:16.121192 18261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:16.121466 18261 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:22:16.121899 18303 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260618 23:22:16.123751 18261 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260618 23:22:16.123853 18261 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260618 23:22:16.123899 18261 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260618 23:22:16.124639 18261 ts_tablet_manager.cc:610] Registered 1 tablets
I20260618 23:22:16.124701 18261 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260618 23:22:16.124761 18303 tablet_bootstrap.cc:492] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408: Bootstrap starting.
I20260618 23:22:16.132018 18261 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:42863
I20260618 23:22:16.132143 18410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:42863 every 8 connection(s)
I20260618 23:22:16.132440 18261 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:22:16.135934 18303 log.cc:824] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:16.138810 18303 tablet_bootstrap.cc:492] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260618 23:22:16.139499 18303 tablet_bootstrap.cc:492] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408: Bootstrap complete.
Jun 18 23:22:16 dist-test-slave-r9ct krb5kdc[17641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824936, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:16.141489 18303 ts_tablet_manager.cc:1397] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.007s
I20260618 23:22:16.141781 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 18261
I20260618 23:22:16.142102 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:41153
--local_ip_for_outbound_sockets=127.3.217.130
--tserver_master_addrs=127.3.217.190:33165
--webserver_port=37705
--webserver_interface=127.3.217.130
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:34013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260618 23:22:16.143669 18303 raft_consensus.cc:348] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:16.144129 18303 raft_consensus.cc:729] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6954d5fbeb924beca053d78bfe642408, State: Initialized, Role: FOLLOWER
I20260618 23:22:16.144282 18303 consensus_queue.cc:260] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:16.144551 18303 ts_tablet_manager.cc:1428] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260618 23:22:16.146178 18413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.133416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.129:44475)
0618 23:22:16.133726 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:16.133762 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:16.134208 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:16.134893 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:16.134898 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:16.135207 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:16.135397 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:16.135402 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.136896 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.136897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:16.137762 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:16.137765 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.138638 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.138640 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:16.138833 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:16.139470 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:16.139482 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:16.141441 (+ 1959us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:16.144221 (+ 2780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:16.144228 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:16.144230 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:16.144679 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:16.144959 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:16.144960 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:16.144961 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:16.145075 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:16.145489 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:16.145495 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:16.145644 (+ 149us) client_negotiation.cc:769] Sending connection context
0618 23:22:16.145760 (+ 116us) client_negotiation.cc:240] Negotiation successful
0618 23:22:16.145945 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":119,"threads_started":1}
I20260618 23:22:16.146179 18414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.133483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:44475 (local address 127.3.217.190:33165)
0618 23:22:16.134481 (+ 998us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:16.134487 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:16.134512 (+ 25us) server_negotiation.cc:407] Connection header received
0618 23:22:16.134611 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:16.134615 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:16.134654 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:16.134846 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:16.135525 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.136762 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.137868 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.138476 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.139117 (+ 641us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:16.141616 (+ 2499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:16.141621 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:16.141622 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:16.141635 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:16.144087 (+ 2452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:16.144785 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:16.144787 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:16.144787 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:16.144874 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:16.145161 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:16.145162 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:16.145162 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:16.145400 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:16.145495 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:16.145817 (+ 322us) server_negotiation.cc:299] Negotiation successful
0618 23:22:16.145947 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":957,"thread_start_us":83,"threads_started":1}
I20260618 23:22:16.147396 18411 heartbeater.cc:347] Connected to a master server at 127.3.217.190:33165
I20260618 23:22:16.147517 18411 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:16.147696 18411 heartbeater.cc:511] Master 127.3.217.190:33165 requested a full tablet report, sending...
I20260618 23:22:16.148427 18223 ts_manager.cc:194] Registered new tserver with Master: 6954d5fbeb924beca053d78bfe642408 (127.3.217.129:42863)
I20260618 23:22:16.149593 18223 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:44475
I20260618 23:22:16.150497 18411 heartbeater.cc:503] Master 127.3.217.190:33165 was elected leader, sending a full tablet report...
I20260618 23:22:16.158592 18418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.149034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:42863 (local address 127.0.0.1:40094)
0618 23:22:16.154483 (+ 5449us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:16.154516 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:16.154625 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:16.154876 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:16.154879 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:16.154881 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:16.154989 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:16.154991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.155939 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.155940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:16.157165 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:16.157168 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.158257 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.158258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:16.158363 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:16.158381 (+ 18us) client_negotiation.cc:769] Sending connection context
0618 23:22:16.158460 (+ 79us) client_negotiation.cc:240] Negotiation successful
0618 23:22:16.158516 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5424,"thread_start_us":87,"threads_started":1}
I20260618 23:22:16.158601 18419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.149282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40094 (local address 127.3.217.129:42863)
0618 23:22:16.154410 (+ 5128us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:16.154414 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:16.154602 (+ 188us) server_negotiation.cc:407] Connection header received
0618 23:22:16.154729 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:16.154731 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:16.154775 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:16.154872 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:16.155072 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.155832 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.157378 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.158132 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.158250 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:16.158352 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:16.158477 (+ 125us) server_negotiation.cc:299] Negotiation successful
0618 23:22:16.158516 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5089,"thread_start_us":68,"threads_started":1}
I20260618 23:22:16.159579 18339 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b738fc081524866a78087aa4631d921 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:22:15 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:40094
I20260618 23:22:16.160243 18420 tablet_replica.cc:330] stopping tablet replica
I20260618 23:22:16.160382 18420 raft_consensus.cc:2229] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:22:16.160451 18420 raft_consensus.cc:2258] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:22:16.160753 18420 ts_tablet_manager.cc:1905] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:22:16.163128 18420 ts_tablet_manager.cc:1918] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:22:16.163311 18420 log.cc:1196] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/wal/wals/8b738fc081524866a78087aa4631d921
I20260618 23:22:16.163705 18420 ts_tablet_manager.cc:1939] T 8b738fc081524866a78087aa4631d921 P 6954d5fbeb924beca053d78bfe642408: Deleting consensus metadata
I20260618 23:22:16.164250 18210 catalog_manager.cc:4841] TS 6954d5fbeb924beca053d78bfe642408 (127.3.217.129:42863): tablet 8b738fc081524866a78087aa4631d921 (table test-table [id=3b8bccc27aae43d98e4e5910eb842c03]) successfully deleted
W20260618 23:22:16.232932 18416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:16.233141 18416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:16.233165 18416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:16.234319 18416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:16.234361 18416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:16.234388 18416 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:22:16.235831 18416 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:34013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:41153
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=37705
--tserver_master_addrs=127.3.217.190:33165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:16.236060 18416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:16.236300 18416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:16.241343 18425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:16.241376 18426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:16.241546 18416 server_base.cc:1034] running on GCE node
W20260618 23:22:16.241366 18428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:16.241806 18416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:16.242067 18416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:16.243417 18416 hybrid_clock.cc:648] HybridClock initialized: now 1781824936243403 us; error 27 us; skew 500 ppm
Jun 18 23:22:16 dist-test-slave-r9ct krb5kdc[17641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824936, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:16.245913 18416 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:22:16.246428 18416 webserver.cc:460] Webserver started at http://127.3.217.130:37705/ using document root <none> and password file <none>
I20260618 23:22:16.246654 18416 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:16.246752 18416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:16.248152 18416 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:22:16.248976 18435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:16.249274 18416 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:22:16.249346 18416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "e044e4babc31486a92110e28b2d3caf9"
format_stamp: "Formatted at 2026-06-18 23:22:15 on dist-test-slave-r9ct"
server_key: "ce1897ffc18768d1bcc05bbbeb317338"
server_key_iv: "f9b7ce42fdb3c1de4e20295da65f6c7d"
server_key_version: "encryptionkey@0"
I20260618 23:22:16.249698 18416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:16.266224 18416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:16.269466 18416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:16.269645 18416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:16.269917 18416 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:22:16.270234 18416 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:22:16.270275 18416 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:16.270298 18416 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:22:16.270311 18416 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:16.276291 18416 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:41153
I20260618 23:22:16.276369 18548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:41153 every 8 connection(s)
I20260618 23:22:16.276688 18416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:22:16.279177 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 18416
I20260618 23:22:16.279539 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:41633
--local_ip_for_outbound_sockets=127.3.217.131
--tserver_master_addrs=127.3.217.190:33165
--webserver_port=36685
--webserver_interface=127.3.217.131
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:34013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 18 23:22:16 dist-test-slave-r9ct krb5kdc[17641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824936, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:16.288501 18414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.277396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:39733 (local address 127.3.217.190:33165)
0618 23:22:16.277464 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:16.277466 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:16.277707 (+ 241us) server_negotiation.cc:407] Connection header received
0618 23:22:16.278222 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:16.278224 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:16.278248 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:16.278458 (+ 210us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:16.279510 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.280368 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.281873 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.282082 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.282145 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:16.284979 (+ 2834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:16.284981 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:16.284981 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:16.284992 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:16.286857 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:16.287387 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:16.287388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:16.287389 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:16.287454 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:16.287780 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:16.287781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:16.287782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:16.287922 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:16.287994 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:16.288342 (+ 348us) server_negotiation.cc:299] Negotiation successful
0618 23:22:16.288427 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260618 23:22:16.288805 18551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.277373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.130:39733)
0618 23:22:16.277570 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:16.277604 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:16.278062 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:16.278523 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:16.278526 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:16.279148 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:16.279408 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:16.279413 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.280489 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.280490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:16.281772 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:16.281775 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.282172 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.282174 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:16.282315 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:16.283016 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:16.283026 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:16.284822 (+ 1796us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:16.286940 (+ 2118us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:16.286947 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:16.286950 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:16.287285 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:16.287532 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:16.287533 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:16.287533 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:16.287683 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:16.288003 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:16.288010 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:16.288184 (+ 174us) client_negotiation.cc:769] Sending connection context
0618 23:22:16.288314 (+ 130us) client_negotiation.cc:240] Negotiation successful
0618 23:22:16.288507 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":94,"threads_started":1}
I20260618 23:22:16.289440 18549 heartbeater.cc:347] Connected to a master server at 127.3.217.190:33165
I20260618 23:22:16.289551 18549 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:16.289746 18549 heartbeater.cc:511] Master 127.3.217.190:33165 requested a full tablet report, sending...
I20260618 23:22:16.290292 18223 ts_manager.cc:194] Registered new tserver with Master: e044e4babc31486a92110e28b2d3caf9 (127.3.217.130:41153)
I20260618 23:22:16.290792 18223 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:39733
W20260618 23:22:16.362798 18552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:16.363003 18552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:16.363024 18552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:16.364193 18552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:16.364239 18552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:16.364265 18552 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:22:16.365761 18552 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:34013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:41633
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=36685
--tserver_master_addrs=127.3.217.190:33165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18552
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:16.366004 18552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:16.366274 18552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:16.371662 18557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:16.371665 18560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:16.371907 18558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:16.371953 18552 server_base.cc:1034] running on GCE node
I20260618 23:22:16.372349 18552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:16.372826 18552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:16.374109 18552 hybrid_clock.cc:648] HybridClock initialized: now 1781824936374027 us; error 93 us; skew 500 ppm
Jun 18 23:22:16 dist-test-slave-r9ct krb5kdc[17641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824936, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:16.376745 18552 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:22:16.377257 18552 webserver.cc:460] Webserver started at http://127.3.217.131:36685/ using document root <none> and password file <none>
I20260618 23:22:16.377496 18552 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:16.377579 18552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:16.379135 18552 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:22:16.380316 18567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:16.380530 18552 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:16.380641 18552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "61a60489bf8f41edba6e3ab271882e42"
format_stamp: "Formatted at 2026-06-18 23:22:15 on dist-test-slave-r9ct"
server_key: "b4dbbb63d7cfb25626b1baacc7d84d7e"
server_key_iv: "488982cddb1a8ea0c1b0c08f7cb52090"
server_key_version: "encryptionkey@0"
I20260618 23:22:16.381004 18552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:16.403003 18552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:16.405524 18552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:16.405792 18552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:16.406095 18552 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:22:16.406505 18552 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:22:16.406653 18552 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:16.406790 18552 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:22:16.406821 18552 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:16.412572 18552 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:41633
I20260618 23:22:16.412717 18680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:41633 every 8 connection(s)
I20260618 23:22:16.413038 18552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:22:16.415494 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 18552
Jun 18 23:22:16 dist-test-slave-r9ct krb5kdc[17641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824936, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:16.423210 18685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.415891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57040 (local address 127.3.217.190:33165)
0618 23:22:16.416017 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:16.416019 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:16.416027 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:22:16.416106 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:16.416107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:16.416118 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:16.416176 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:16.416853 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.417327 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.418214 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.418416 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.418502 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:16.420150 (+ 1648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:16.420153 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:16.420154 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:16.420170 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:16.422017 (+ 1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:16.422377 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:16.422378 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:16.422379 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:16.422435 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:16.422644 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:16.422645 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:16.422645 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:16.422795 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:16.422971 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:16.423009 (+ 38us) server_negotiation.cc:299] Negotiation successful
0618 23:22:16.423084 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":64,"threads_started":1}
I20260618 23:22:16.424389 18414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.413825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:51643 (local address 127.3.217.190:33165)
0618 23:22:16.413886 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:16.413888 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:16.414057 (+ 169us) server_negotiation.cc:407] Connection header received
0618 23:22:16.414622 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:16.414623 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:16.414633 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:16.414689 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:16.415958 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.416447 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.417534 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.417791 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.417872 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:16.421350 (+ 3478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:16.421352 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:16.421352 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:16.421358 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:16.423004 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:16.423484 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:16.423484 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:16.423485 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:16.423538 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:16.423840 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:16.423841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:16.423841 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:16.423975 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:16.424037 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:16.424280 (+ 243us) server_negotiation.cc:299] Negotiation successful
0618 23:22:16.424336 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260618 23:22:16.424558 18683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.413797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.131:51643)
0618 23:22:16.413944 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:16.413978 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:16.414507 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:16.414799 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:16.414802 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:16.415355 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:16.415560 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:16.415565 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.416556 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.416557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:16.417431 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:16.417434 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.417883 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.417884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:16.418018 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:16.418536 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:16.418544 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:16.421015 (+ 2471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:16.423103 (+ 2088us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:16.423109 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:16.423111 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:16.423421 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:16.423612 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:16.423613 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:16.423613 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:16.423763 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:16.424054 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:16.424059 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:16.424166 (+ 107us) client_negotiation.cc:769] Sending connection context
0618 23:22:16.424253 (+ 87us) client_negotiation.cc:240] Negotiation successful
0618 23:22:16.424366 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":88,"threads_started":1}
I20260618 23:22:16.425019 18681 heartbeater.cc:347] Connected to a master server at 127.3.217.190:33165
I20260618 23:22:16.425117 18681 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:16.425280 18681 heartbeater.cc:511] Master 127.3.217.190:33165 requested a full tablet report, sending...
I20260618 23:22:16.425670 18223 ts_manager.cc:194] Registered new tserver with Master: 61a60489bf8f41edba6e3ab271882e42 (127.3.217.131:41633)
I20260618 23:22:16.426036 18223 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:51643
I20260618 23:22:16.434958 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260618 23:22:16.437922 18414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.435331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57056 (local address 127.3.217.190:33165)
0618 23:22:16.435399 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:16.435401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:16.435524 (+ 123us) server_negotiation.cc:407] Connection header received
0618 23:22:16.435625 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:16.435625 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:16.435662 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:16.435764 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:22:16.435886 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.436366 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.437125 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.437328 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.437411 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:16.437572 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:22:16.437671 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:22:16.437771 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:16.437797 (+ 26us) server_negotiation.cc:299] Negotiation successful
0618 23:22:16.437848 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260618 23:22:16.438393 18223 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:57056:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:22:16.440069 18223 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:22:16.442564 18339 tablet_service.cc:1467] Processing CreateTablet for tablet cd30a0b6f70e4764be2191de87b67026 (DEFAULT_TABLE table=test-table [id=004caa47a1f74cd1a3fca7008f6f22a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:22:16.442806 18339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd30a0b6f70e4764be2191de87b67026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:16.444413 18303 tablet_bootstrap.cc:492] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408: Bootstrap starting.
I20260618 23:22:16.444813 18303 tablet_bootstrap.cc:654] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408: Neither blocks nor log segments found. Creating new log.
I20260618 23:22:16.445363 18303 tablet_bootstrap.cc:492] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408: No bootstrap required, opened a new log
I20260618 23:22:16.445415 18303 ts_tablet_manager.cc:1397] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260618 23:22:16.445573 18303 raft_consensus.cc:348] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:16.445652 18303 raft_consensus.cc:374] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:22:16.445700 18303 raft_consensus.cc:729] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6954d5fbeb924beca053d78bfe642408, State: Initialized, Role: FOLLOWER
I20260618 23:22:16.445744 18303 consensus_queue.cc:260] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:16.445844 18303 ts_tablet_manager.cc:1428] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:16.447371 18418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.442381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:41633 (local address 127.0.0.1:50560)
0618 23:22:16.442442 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:16.442453 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:16.442491 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:16.442961 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:16.442962 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:16.442963 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:16.443012 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:16.443013 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.444842 (+ 1829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.444843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:16.445968 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:16.445970 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.447170 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.447171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:16.447228 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:16.447231 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:22:16.447285 (+ 54us) client_negotiation.cc:240] Negotiation successful
0618 23:22:16.447321 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260618 23:22:16.447438 18688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.442567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50560 (local address 127.3.217.131:41633)
0618 23:22:16.442815 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:16.442820 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:16.442831 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:22:16.442871 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:16.442873 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:16.442890 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:16.442968 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:16.443091 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.444696 (+ 1605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.446150 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.447060 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.447150 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:16.447206 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:16.447301 (+ 95us) server_negotiation.cc:299] Negotiation successful
0618 23:22:16.447343 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":82,"threads_started":1}
I20260618 23:22:16.448014 18687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.442381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:41153 (local address 127.0.0.1:53488)
0618 23:22:16.442776 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:16.442787 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:16.442838 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:16.443832 (+ 994us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:16.443832 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:16.443835 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:16.443883 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:16.443885 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.445268 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.445269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:16.446378 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:16.446380 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.447757 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.447758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:16.447823 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:16.447827 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:22:16.447896 (+ 69us) client_negotiation.cc:240] Negotiation successful
0618 23:22:16.447939 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"mutex_wait_us":20,"thread_start_us":94,"threads_started":1}
I20260618 23:22:16.448068 18689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.442595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53488 (local address 127.3.217.130:41153)
0618 23:22:16.443419 (+ 824us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:16.443426 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:16.443444 (+ 18us) server_negotiation.cc:407] Connection header received
0618 23:22:16.443527 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:16.443530 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:16.443707 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:16.443808 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:16.443983 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.445086 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.446463 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.447372 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.447447 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:16.447498 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:16.447947 (+ 449us) server_negotiation.cc:299] Negotiation successful
0618 23:22:16.447993 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":80,"threads_started":1}
I20260618 23:22:16.448199 18615 tablet_service.cc:1467] Processing CreateTablet for tablet cd30a0b6f70e4764be2191de87b67026 (DEFAULT_TABLE table=test-table [id=004caa47a1f74cd1a3fca7008f6f22a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:22:16.448553 18615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd30a0b6f70e4764be2191de87b67026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:16.449038 18483 tablet_service.cc:1467] Processing CreateTablet for tablet cd30a0b6f70e4764be2191de87b67026 (DEFAULT_TABLE table=test-table [id=004caa47a1f74cd1a3fca7008f6f22a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:22:16.449532 18483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd30a0b6f70e4764be2191de87b67026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:16.451848 18691 tablet_bootstrap.cc:492] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42: Bootstrap starting.
I20260618 23:22:16.452389 18692 tablet_bootstrap.cc:492] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9: Bootstrap starting.
I20260618 23:22:16.452432 18691 tablet_bootstrap.cc:654] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42: Neither blocks nor log segments found. Creating new log.
I20260618 23:22:16.452940 18692 tablet_bootstrap.cc:654] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9: Neither blocks nor log segments found. Creating new log.
I20260618 23:22:16.453002 18691 log.cc:824] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:16.453521 18692 log.cc:824] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:16.453840 18691 tablet_bootstrap.cc:492] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42: No bootstrap required, opened a new log
I20260618 23:22:16.453913 18691 ts_tablet_manager.cc:1397] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:22:16.454366 18692 tablet_bootstrap.cc:492] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9: No bootstrap required, opened a new log
I20260618 23:22:16.454463 18692 ts_tablet_manager.cc:1397] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:22:16.455554 18691 raft_consensus.cc:348] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:16.455710 18691 raft_consensus.cc:374] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:22:16.455767 18691 raft_consensus.cc:729] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61a60489bf8f41edba6e3ab271882e42, State: Initialized, Role: FOLLOWER
I20260618 23:22:16.455883 18691 consensus_queue.cc:260] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:16.456017 18692 raft_consensus.cc:348] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:16.456179 18681 heartbeater.cc:503] Master 127.3.217.190:33165 was elected leader, sending a full tablet report...
I20260618 23:22:16.456187 18692 raft_consensus.cc:374] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:22:16.456226 18692 raft_consensus.cc:729] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e044e4babc31486a92110e28b2d3caf9, State: Initialized, Role: FOLLOWER
I20260618 23:22:16.456332 18692 consensus_queue.cc:260] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:16.456400 18691 ts_tablet_manager.cc:1428] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260618 23:22:16.456588 18692 ts_tablet_manager.cc:1428] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:22:16.456624 18549 heartbeater.cc:503] Master 127.3.217.190:33165 was elected leader, sending a full tablet report...
I20260618 23:22:16.476714 18696 raft_consensus.cc:482] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:22:16.476817 18696 raft_consensus.cc:504] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:16.477131 18696 leader_election.cc:288] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61a60489bf8f41edba6e3ab271882e42 (127.3.217.131:41633), 6954d5fbeb924beca053d78bfe642408 (127.3.217.129:42863)
I20260618 23:22:16.480717 18551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.477291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:42863 (local address 127.3.217.130:44561)
0618 23:22:16.477354 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:16.477367 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:16.477411 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:16.477614 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:16.477616 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:16.477618 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:16.477710 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:16.477712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.478577 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.478580 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:16.479777 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:16.479780 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.480499 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.480500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:16.480566 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:16.480569 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:22:16.480620 (+ 51us) client_negotiation.cc:240] Negotiation successful
0618 23:22:16.480651 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260618 23:22:16.480775 18419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.477344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:44561 (local address 127.3.217.129:42863)
0618 23:22:16.477392 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:16.477394 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:16.477405 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:22:16.477481 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:16.477482 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:16.477493 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:16.477550 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:16.477813 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.478468 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.479976 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.480405 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.480481 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:16.480490 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:16.480645 (+ 155us) server_negotiation.cc:299] Negotiation successful
0618 23:22:16.480707 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260618 23:22:16.481194 18697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.477307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:41633 (local address 127.3.217.130:57477)
0618 23:22:16.477458 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:16.477468 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:16.477535 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:16.477815 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:16.477816 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:16.477817 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:16.477881 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:16.477882 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.479053 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.479054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:16.480170 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:16.480172 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.480978 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.480979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:16.481046 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:16.481049 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:22:16.481102 (+ 53us) client_negotiation.cc:240] Negotiation successful
0618 23:22:16.481136 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":87,"threads_started":1}
I20260618 23:22:16.481128 18365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd30a0b6f70e4764be2191de87b67026" candidate_uuid: "e044e4babc31486a92110e28b2d3caf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6954d5fbeb924beca053d78bfe642408" is_pre_election: true
I20260618 23:22:16.481294 18688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.477395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:57477 (local address 127.3.217.131:41633)
0618 23:22:16.477436 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:16.477438 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:16.477596 (+ 158us) server_negotiation.cc:407] Connection header received
0618 23:22:16.477623 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:16.477624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:16.477634 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:16.477716 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:16.478110 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.478951 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.480287 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.480871 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.480938 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:16.480946 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:16.481123 (+ 177us) server_negotiation.cc:299] Negotiation successful
0618 23:22:16.481173 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260618 23:22:16.481308 18365 raft_consensus.cc:2454] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e044e4babc31486a92110e28b2d3caf9 in term 0.
I20260618 23:22:16.481576 18439 leader_election.cc:302] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6954d5fbeb924beca053d78bfe642408, e044e4babc31486a92110e28b2d3caf9; no voters:
I20260618 23:22:16.481611 18635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd30a0b6f70e4764be2191de87b67026" candidate_uuid: "e044e4babc31486a92110e28b2d3caf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61a60489bf8f41edba6e3ab271882e42" is_pre_election: true
I20260618 23:22:16.481729 18696 raft_consensus.cc:2781] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:22:16.481755 18635 raft_consensus.cc:2454] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e044e4babc31486a92110e28b2d3caf9 in term 0.
I20260618 23:22:16.481791 18696 raft_consensus.cc:482] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:22:16.481820 18696 raft_consensus.cc:3037] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:22:16.482498 18696 raft_consensus.cc:504] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:16.482657 18696 leader_election.cc:288] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [CANDIDATE]: Term 1 election: Requested vote from peers 61a60489bf8f41edba6e3ab271882e42 (127.3.217.131:41633), 6954d5fbeb924beca053d78bfe642408 (127.3.217.129:42863)
I20260618 23:22:16.482820 18635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd30a0b6f70e4764be2191de87b67026" candidate_uuid: "e044e4babc31486a92110e28b2d3caf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61a60489bf8f41edba6e3ab271882e42"
I20260618 23:22:16.482851 18365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd30a0b6f70e4764be2191de87b67026" candidate_uuid: "e044e4babc31486a92110e28b2d3caf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6954d5fbeb924beca053d78bfe642408"
I20260618 23:22:16.482887 18635 raft_consensus.cc:3037] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:22:16.482909 18365 raft_consensus.cc:3037] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:22:16.483642 18635 raft_consensus.cc:2454] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e044e4babc31486a92110e28b2d3caf9 in term 1.
I20260618 23:22:16.483831 18437 leader_election.cc:302] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61a60489bf8f41edba6e3ab271882e42, e044e4babc31486a92110e28b2d3caf9; no voters:
I20260618 23:22:16.483919 18696 raft_consensus.cc:2781] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:22:16.484058 18365 raft_consensus.cc:2454] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e044e4babc31486a92110e28b2d3caf9 in term 1.
I20260618 23:22:16.484081 18696 raft_consensus.cc:686] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 1 LEADER]: Becoming Leader. State: Replica: e044e4babc31486a92110e28b2d3caf9, State: Running, Role: LEADER
I20260618 23:22:16.484171 18696 consensus_queue.cc:237] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:16.485152 18223 catalog_manager.cc:5495] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e044e4babc31486a92110e28b2d3caf9 (127.3.217.130). New cstate: current_term: 1 leader_uuid: "e044e4babc31486a92110e28b2d3caf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } health_report { overall_health: UNKNOWN } } }
I20260618 23:22:16.492743 18689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.490448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53492 (local address 127.3.217.130:41153)
0618 23:22:16.490490 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:16.490492 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:16.490501 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:22:16.490578 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:16.490579 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:16.490602 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:16.490676 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:22:16.490834 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.491273 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.492007 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:16.492194 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:16.492269 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:16.492426 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:22:16.492512 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:22:16.492601 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:16.492624 (+ 23us) server_negotiation.cc:299] Negotiation successful
0618 23:22:16.492644 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260618 23:22:16.494532 18365 raft_consensus.cc:1261] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408 [term 1 FOLLOWER]: Refusing update from remote peer e044e4babc31486a92110e28b2d3caf9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:22:16.494544 18635 raft_consensus.cc:1261] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42 [term 1 FOLLOWER]: Refusing update from remote peer e044e4babc31486a92110e28b2d3caf9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:22:16.494869 18696 consensus_queue.cc:1035] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:22:16.495021 18698 consensus_queue.cc:1035] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:22:16.497509 18703 mvcc.cc:205] Tried to move back new op lower bound from 7298354939879170048 to 7298354939839823872. Current Snapshot: MvccSnapshot[applied={T|T < 7298354939879170048}]
I20260618 23:22:16.497844 18702 mvcc.cc:205] Tried to move back new op lower bound from 7298354939879170048 to 7298354939839823872. Current Snapshot: MvccSnapshot[applied={T|T < 7298354939879170048 or (T in {7298354939879170048})}]
I20260618 23:22:16.499967 18223 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:57056:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:22:16.500067 18223 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:57056:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:22:16.500880 18223 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f: Sending DeleteTablet for 3 replicas of tablet cd30a0b6f70e4764be2191de87b67026
I20260618 23:22:16.501235 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 18261
I20260618 23:22:16.501260 18339 tablet_service.cc:1514] Processing DeleteTablet for tablet cd30a0b6f70e4764be2191de87b67026 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:22:16 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:40094
I20260618 23:22:16.501245 18615 tablet_service.cc:1514] Processing DeleteTablet for tablet cd30a0b6f70e4764be2191de87b67026 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:22:16 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:50560
I20260618 23:22:16.501559 18483 tablet_service.cc:1514] Processing DeleteTablet for tablet cd30a0b6f70e4764be2191de87b67026 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:22:16 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:53488
I20260618 23:22:16.503508 18710 tablet_replica.cc:330] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42: stopping tablet replica
I20260618 23:22:16.503625 18710 raft_consensus.cc:2229] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:22:16.503752 18710 raft_consensus.cc:2258] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:22:16.504769 18710 ts_tablet_manager.cc:1905] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:22:16.506765 18710 ts_tablet_manager.cc:1918] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:22:16.506843 18710 log.cc:1196] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/cd30a0b6f70e4764be2191de87b67026
I20260618 23:22:16.507112 18710 ts_tablet_manager.cc:1939] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42: Deleting consensus metadata
I20260618 23:22:16.507658 18208 catalog_manager.cc:4841] TS 61a60489bf8f41edba6e3ab271882e42 (127.3.217.131:41633): tablet cd30a0b6f70e4764be2191de87b67026 (table test-table [id=004caa47a1f74cd1a3fca7008f6f22a9]) successfully deleted
W20260618 23:22:16.509631 18210 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.217.129:42863 (error 108)
I20260618 23:22:16.509843 18711 tablet_replica.cc:330] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9: stopping tablet replica
I20260618 23:22:16.509971 18711 raft_consensus.cc:2229] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:22:16.510094 18711 raft_consensus.cc:2258] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:22:16.510342 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 18416
I20260618 23:22:16.510365 18687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.510217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:42863 (local address 127.0.0.1:40096)
0618 23:22:16.510278 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:16.510327 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.129:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260618 23:22:16.510479 18210 catalog_manager.cc:4584] TS 6954d5fbeb924beca053d78bfe642408 (127.3.217.129:42863): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cd30a0b6f70e4764be2191de87b67026: Network error: Client connection negotiation failed: client connection to 127.3.217.129:42863: connect: Connection refused (error 111)
I20260618 23:22:16.515786 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 18552
I20260618 23:22:16.516000 18687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.515809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:41153 (local address 127.0.0.1:53508)
0618 23:22:16.515914 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:16.515954 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.130:41153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260618 23:22:16.520568 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 18190
I20260618 23:22:16.526116 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:33165
--webserver_interface=127.3.217.190
--webserver_port=33271
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:34013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:33165
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:22:16.606987 18713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:16.607225 18713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:16.607273 18713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:16.608446 18713 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:22:16.608517 18713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:16.608544 18713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:16.608577 18713 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:22:16.608599 18713 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:22:16.610075 18713 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:34013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:33165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:33165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=33271
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:16.610353 18713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:16.610589 18713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:16.615298 18718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:16.615315 18719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:16.615517 18721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:16.615533 18713 server_base.cc:1034] running on GCE node
I20260618 23:22:16.615806 18713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:16.616044 18713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:16.617182 18713 hybrid_clock.cc:648] HybridClock initialized: now 1781824936617172 us; error 29 us; skew 500 ppm
Jun 18 23:22:16 dist-test-slave-r9ct krb5kdc[17641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824936, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:16.619819 18713 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:22:16.620227 18713 webserver.cc:460] Webserver started at http://127.3.217.190:33271/ using document root <none> and password file <none>
I20260618 23:22:16.620457 18713 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:16.620524 18713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:16.622045 18713 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:16.622988 18728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:16.623346 18713 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:16.623457 18713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "8e427868420b4a688e93390f8d74d76f"
format_stamp: "Formatted at 2026-06-18 23:22:14 on dist-test-slave-r9ct"
server_key: "c9c409def84b9c9e5cd1873d26eb3880"
server_key_iv: "a927b738b91e6c228d26c1807b27f8c6"
server_key_version: "encryptionkey@0"
I20260618 23:22:16.623814 18713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:16.641662 18713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:16.644169 18713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:16.644340 18713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:16.649029 18713 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:33165
I20260618 23:22:16.649173 18780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:33165 every 8 connection(s)
I20260618 23:22:16.649487 18713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:22:16.651247 18781 sys_catalog.cc:263] Verifying existing consensus state
I20260618 23:22:16.651592 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 18713
I20260618 23:22:16.651901 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:42863
--local_ip_for_outbound_sockets=127.3.217.129
--tserver_master_addrs=127.3.217.190:33165
--webserver_port=36041
--webserver_interface=127.3.217.129
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:34013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260618 23:22:16.652017 18781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f: Bootstrap starting.
I20260618 23:22:16.661581 18781 log.cc:824] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:16.663913 18781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260618 23:22:16.664208 18781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f: Bootstrap complete.
I20260618 23:22:16.666577 18781 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e427868420b4a688e93390f8d74d76f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33165 } }
I20260618 23:22:16.666850 18781 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e427868420b4a688e93390f8d74d76f, State: Initialized, Role: FOLLOWER
I20260618 23:22:16.667043 18781 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e427868420b4a688e93390f8d74d76f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33165 } }
I20260618 23:22:16.667135 18781 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:22:16.667197 18781 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:22:16.667248 18781 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 2 FOLLOWER]: Advancing to term 3
I20260618 23:22:16.668267 18781 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e427868420b4a688e93390f8d74d76f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33165 } }
I20260618 23:22:16.668381 18781 leader_election.cc:302] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e427868420b4a688e93390f8d74d76f; no voters:
I20260618 23:22:16.668562 18781 leader_election.cc:288] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [CANDIDATE]: Term 3 election: Requested vote from peers
I20260618 23:22:16.668603 18785 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 3 FOLLOWER]: Leader election won for term 3
I20260618 23:22:16.668720 18785 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [term 3 LEADER]: Becoming Leader. State: Replica: 8e427868420b4a688e93390f8d74d76f, State: Running, Role: LEADER
I20260618 23:22:16.668798 18785 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e427868420b4a688e93390f8d74d76f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33165 } }
I20260618 23:22:16.668823 18781 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:22:16.669258 18787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e427868420b4a688e93390f8d74d76f. Latest consensus state: current_term: 3 leader_uuid: "8e427868420b4a688e93390f8d74d76f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e427868420b4a688e93390f8d74d76f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33165 } } }
I20260618 23:22:16.669329 18787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [sys.catalog]: This master's current role is: LEADER
I20260618 23:22:16.669515 18789 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:22:16.670111 18786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "8e427868420b4a688e93390f8d74d76f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e427868420b4a688e93390f8d74d76f" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33165 } } }
I20260618 23:22:16.670207 18786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e427868420b4a688e93390f8d74d76f [sys.catalog]: This master's current role is: LEADER
I20260618 23:22:16.670681 18789 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:22:16.670846 18789 catalog_manager.cc:1259] Loaded cluster ID: f14a3cc137cd4029b80621a3ab8096a3
I20260618 23:22:16.671105 18789 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260618 23:22:16.671337 18789 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fda10ad49ad google::LogMessage::Fail() at ??:0
@ 0x7fda10ad788a google::LogMessage::SendToLog() at ??:0
@ 0x7fda10ad44de google::LogMessage::Flush() at ??:0
@ 0x7fda10ad5a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fda189f50f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fda189fe8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fda129a20d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fda12997954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fda137fb6db start_thread at ??:0
@ 0x7fda0f5d261f clone at ??:0
W20260618 23:22:16.751154 18783 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:16.751350 18783 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:16.751375 18783 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:16.752648 18783 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:16.752692 18783 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:16.752720 18783 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:22:16.754156 18783 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:34013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:42863
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=36041
--tserver_master_addrs=127.3.217.190:33165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18783
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:16.754411 18783 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:16.754657 18783 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:16.760326 18820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:16.760336 18818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:16.760387 18817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:16.760648 18783 server_base.cc:1034] running on GCE node
I20260618 23:22:16.760843 18783 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:16.761124 18783 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:16.762367 18783 hybrid_clock.cc:648] HybridClock initialized: now 1781824936762324 us; error 44 us; skew 500 ppm
Jun 18 23:22:16 dist-test-slave-r9ct krb5kdc[17641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824936, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:16.765879 18783 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:22:16.766860 18783 webserver.cc:460] Webserver started at http://127.3.217.129:36041/ using document root <none> and password file <none>
I20260618 23:22:16.767148 18783 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:16.767231 18783 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:16.768651 18783 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:22:16.769459 18827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:16.769748 18783 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:22:16.769857 18783 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "6954d5fbeb924beca053d78bfe642408"
format_stamp: "Formatted at 2026-06-18 23:22:15 on dist-test-slave-r9ct"
server_key: "7227cd136757c18f561401fb16814dc5"
server_key_iv: "35d71b80848f31aaee8f8d68251dab05"
server_key_version: "encryptionkey@0"
I20260618 23:22:16.770229 18783 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:16.789584 18783 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:16.792285 18783 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:16.792450 18783 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:16.792685 18783 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:22:16.793151 18834 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260618 23:22:16.794587 18783 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260618 23:22:16.794646 18783 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260618 23:22:16.794678 18783 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260618 23:22:16.795532 18783 ts_tablet_manager.cc:610] Registered 1 tablets
I20260618 23:22:16.795583 18783 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260618 23:22:16.795657 18834 tablet_bootstrap.cc:492] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408: Bootstrap starting.
I20260618 23:22:16.803002 18783 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:42863
I20260618 23:22:16.803172 18941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:42863 every 8 connection(s)
I20260618 23:22:16.803464 18783 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:22:16.807133 18834 log.cc:824] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:16.807711 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 18783
I20260618 23:22:16.808032 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:41153
--local_ip_for_outbound_sockets=127.3.217.130
--tserver_master_addrs=127.3.217.190:33165
--webserver_port=37705
--webserver_interface=127.3.217.130
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:34013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260618 23:22:16.810787 18834 tablet_bootstrap.cc:492] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260618 23:22:16.811380 18834 tablet_bootstrap.cc:492] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408: Bootstrap complete.
I20260618 23:22:16.812892 18834 ts_tablet_manager.cc:1397] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.009s
I20260618 23:22:16.814363 18834 raft_consensus.cc:348] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:16.814684 18834 raft_consensus.cc:729] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6954d5fbeb924beca053d78bfe642408, State: Initialized, Role: FOLLOWER
I20260618 23:22:16.814846 18834 consensus_queue.cc:260] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:16.815122 18834 ts_tablet_manager.cc:1428] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408: Time spent starting tablet: real 0.002s user 0.001s sys 0.003s
W20260618 23:22:16.883967 18944 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:22:16.804868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.129:59515)
0618 23:22:16.805120 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:16.805220 (+ 100us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:16.806314 (+ 1094us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:16.883760 (+ 77446us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":108,"threads_started":1}
W20260618 23:22:16.884248 18942 heartbeater.cc:644] Failed to heartbeat to 127.3.217.190:33165 (0 consecutive failures): Network error: Failed to ping master at 127.3.217.190:33165: Client connection negotiation failed: client connection to 127.3.217.190:33165: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260618 23:22:16.884630 18944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.884500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.129:46265)
0618 23:22:16.884561 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:16.884605 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260618 23:22:16.885068 18944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.884969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.129:38501)
0618 23:22:16.885017 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:16.885046 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260618 23:22:16.885188 18942 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260618 23:22:16.892947 18946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:16.893131 18946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:16.893163 18946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:16.894210 18946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:16.894243 18946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:16.894268 18946 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:22:16.895680 18946 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:34013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:41153
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=37705
--tserver_master_addrs=127.3.217.190:33165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:16.895859 18946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:16.896024 18946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:16.901144 18953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:16.901134 18955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:16.901139 18952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:16.901362 18946 server_base.cc:1034] running on GCE node
I20260618 23:22:16.901535 18946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:16.901727 18946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:16.902859 18946 hybrid_clock.cc:648] HybridClock initialized: now 1781824936902847 us; error 26 us; skew 500 ppm
Jun 18 23:22:16 dist-test-slave-r9ct krb5kdc[17641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824936, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:16.905532 18946 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:22:16.906013 18946 webserver.cc:460] Webserver started at http://127.3.217.130:37705/ using document root <none> and password file <none>
I20260618 23:22:16.906271 18946 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:16.906342 18946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:16.907976 18946 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:16.909066 18962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:16.909338 18946 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:16.909456 18946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "e044e4babc31486a92110e28b2d3caf9"
format_stamp: "Formatted at 2026-06-18 23:22:15 on dist-test-slave-r9ct"
server_key: "ce1897ffc18768d1bcc05bbbeb317338"
server_key_iv: "f9b7ce42fdb3c1de4e20295da65f6c7d"
server_key_version: "encryptionkey@0"
I20260618 23:22:16.909834 18946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:16.922415 18946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:16.924727 18946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:16.924893 18946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:16.925132 18946 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:22:16.925551 18969 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260618 23:22:16.927255 18946 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260618 23:22:16.927335 18946 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260618 23:22:16.927379 18946 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260618 23:22:16.928025 18946 ts_tablet_manager.cc:610] Registered 1 tablets
I20260618 23:22:16.928083 18946 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260618 23:22:16.928180 18969 tablet_bootstrap.cc:492] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9: Bootstrap starting.
I20260618 23:22:16.929898 18969 log.cc:824] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:16.932222 18969 tablet_bootstrap.cc:492] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260618 23:22:16.932518 18969 tablet_bootstrap.cc:492] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9: Bootstrap complete.
I20260618 23:22:16.932682 18969 ts_tablet_manager.cc:1397] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260618 23:22:16.933947 18969 raft_consensus.cc:348] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:16.934206 18969 raft_consensus.cc:729] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e044e4babc31486a92110e28b2d3caf9, State: Initialized, Role: FOLLOWER
I20260618 23:22:16.934376 18969 consensus_queue.cc:260] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:16.934669 18969 ts_tablet_manager.cc:1428] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9: Time spent starting tablet: real 0.002s user 0.000s sys 0.004s
I20260618 23:22:16.935361 18946 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:41153
I20260618 23:22:16.935487 19078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:41153 every 8 connection(s)
I20260618 23:22:16.935751 18946 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:22:16.936753 19081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.936411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.130:44717)
0618 23:22:16.936571 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:16.936639 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":63,"threads_started":1}
W20260618 23:22:16.936949 19079 heartbeater.cc:644] Failed to heartbeat to 127.3.217.190:33165 (0 consecutive failures): Network error: Failed to ping master at 127.3.217.190:33165: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
I20260618 23:22:16.937251 19081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.937133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.130:43095)
0618 23:22:16.937180 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:16.937204 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260618 23:22:16.937496 19081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:16.937440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.130:55589)
0618 23:22:16.937467 (+ 27us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:16.937485 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260618 23:22:16.937592 19079 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260618 23:22:16.944478 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 18946
I20260618 23:22:16.944721 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:41633
--local_ip_for_outbound_sockets=127.3.217.131
--tserver_master_addrs=127.3.217.190:33165
--webserver_port=36685
--webserver_interface=127.3.217.131
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:34013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:22:17.025755 19082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:17.025986 19082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:17.026022 19082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:17.027168 19082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:17.027237 19082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:17.027290 19082 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:22:17.028733 19082 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:34013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:41633
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=36685
--tserver_master_addrs=127.3.217.190:33165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:17.028999 19082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:17.029232 19082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:17.034235 19087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:17.034304 19088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:17.034278 19090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:17.034477 19082 server_base.cc:1034] running on GCE node
I20260618 23:22:17.034680 19082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:17.034989 19082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:17.036217 19082 hybrid_clock.cc:648] HybridClock initialized: now 1781824937036201 us; error 35 us; skew 500 ppm
Jun 18 23:22:17 dist-test-slave-r9ct krb5kdc[17641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824937, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:17.038936 19082 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:22:17.039482 19082 webserver.cc:460] Webserver started at http://127.3.217.131:36685/ using document root <none> and password file <none>
I20260618 23:22:17.039726 19082 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:17.039803 19082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:17.041333 19082 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:22:17.042029 19097 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:17.042209 19082 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260618 23:22:17.042310 19082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "61a60489bf8f41edba6e3ab271882e42"
format_stamp: "Formatted at 2026-06-18 23:22:15 on dist-test-slave-r9ct"
server_key: "b4dbbb63d7cfb25626b1baacc7d84d7e"
server_key_iv: "488982cddb1a8ea0c1b0c08f7cb52090"
server_key_version: "encryptionkey@0"
I20260618 23:22:17.042654 19082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:17.050225 19082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:17.052456 19082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:17.052611 19082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:17.052830 19082 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:22:17.053119 19082 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:22:17.053174 19082 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:17.053211 19082 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:22:17.053239 19082 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:17.059943 19082 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:41633
I20260618 23:22:17.060019 19210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:41633 every 8 connection(s)
I20260618 23:22:17.060374 19082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:22:17.061426 19213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:17.061042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.131:34703)
0618 23:22:17.061196 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:17.061290 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":69,"threads_started":1}
W20260618 23:22:17.061838 19211 heartbeater.cc:644] Failed to heartbeat to 127.3.217.190:33165 (0 consecutive failures): Network error: Failed to ping master at 127.3.217.190:33165: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
I20260618 23:22:17.062156 19213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:17.062067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.131:43703)
0618 23:22:17.062113 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:17.062139 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260618 23:22:17.062422 19213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:17.062374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.131:51443)
0618 23:22:17.062394 (+ 20us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:17.062411 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260618 23:22:17.062534 19211 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260618 23:22:17.069859 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 19082
I20260618 23:22:17.885831 19215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:17.885566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.129:56033)
0618 23:22:17.885722 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:17.885757 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":88,"threads_started":1}
I20260618 23:22:17.938256 19216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:17.937969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.130:35881)
0618 23:22:17.938138 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:17.938170 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":71,"threads_started":1}
I20260618 23:22:18.063125 19217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:18.062900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.131:55795)
0618 23:22:18.063040 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:18.063080 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":76,"threads_started":1}
I20260618 23:22:18.445035 19218 raft_consensus.cc:482] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:22:18.445190 19218 raft_consensus.cc:504] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:18.445600 19218 leader_election.cc:288] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61a60489bf8f41edba6e3ab271882e42 (127.3.217.131:41633), 6954d5fbeb924beca053d78bfe642408 (127.3.217.129:42863)
Jun 18 23:22:18 dist-test-slave-r9ct krb5kdc[17641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824936, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.131@KRBTEST.COM
Jun 18 23:22:18 dist-test-slave-r9ct krb5kdc[17641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824936, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.129@KRBTEST.COM
I20260618 23:22:18.456015 19221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:18.445903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:32861 (local address 127.3.217.131:41633)
0618 23:22:18.446093 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:18.446105 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:18.446141 (+ 36us) server_negotiation.cc:407] Connection header received
0618 23:22:18.446785 (+ 644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:18.446788 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:18.446830 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:18.446930 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:18.447430 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:18.448295 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:18.449485 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:18.449881 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:18.450008 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:18.452485 (+ 2477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:18.452489 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:18.452489 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:18.452518 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:18.454332 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:18.454815 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:18.454818 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:18.454818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:18.454908 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:18.455162 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:18.455163 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:18.455164 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:18.455395 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:18.455483 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:18.455788 (+ 305us) server_negotiation.cc:299] Negotiation successful
0618 23:22:18.455903 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":58,"threads_started":1}
I20260618 23:22:18.456033 19220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:18.445775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:41633 (local address 127.3.217.130:32861)
0618 23:22:18.445940 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:18.445948 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:18.446128 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:18.446951 (+ 823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:18.446952 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:18.447105 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:18.447308 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:18.447315 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:18.448405 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:18.448406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:18.449381 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:18.449384 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:18.449979 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:18.449980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:18.450101 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:18.450692 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:18.450699 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:18.452362 (+ 1663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:18.454453 (+ 2091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:18.454460 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:18.454463 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:18.454685 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:18.454983 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:18.454983 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:18.454984 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:18.455086 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:18.455477 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:18.455483 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:18.455608 (+ 125us) client_negotiation.cc:769] Sending connection context
0618 23:22:18.455738 (+ 130us) client_negotiation.cc:240] Negotiation successful
0618 23:22:18.455904 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":3,"spinlock_wait_cycles":12672,"thread_start_us":77,"threads_started":1}
I20260618 23:22:18.456357 19219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:18.445772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:42863 (local address 127.3.217.130:55207)
0618 23:22:18.445917 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:18.445939 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:18.446128 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:18.446548 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:18.446552 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:18.446998 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:18.447461 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:18.447463 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:18.448493 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:18.448494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:18.449380 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:18.449383 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:18.449977 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:18.449978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:18.450100 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:18.450759 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:18.450765 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:18.453097 (+ 2332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:18.455095 (+ 1998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:18.455096 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:18.455096 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:18.455264 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:18.455523 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:18.455524 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:18.455525 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:18.455584 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:18.455964 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:18.455965 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:18.456009 (+ 44us) client_negotiation.cc:769] Sending connection context
0618 23:22:18.456103 (+ 94us) client_negotiation.cc:240] Negotiation successful
0618 23:22:18.456222 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":75,"threads_started":1}
I20260618 23:22:18.456629 19222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:18.446020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:55207 (local address 127.3.217.129:42863)
0618 23:22:18.446291 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:18.446294 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:18.446332 (+ 38us) server_negotiation.cc:407] Connection header received
0618 23:22:18.446393 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:18.446394 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:18.446412 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:18.446505 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:18.447566 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:18.448393 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:18.449491 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:18.449878 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:18.449998 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:18.453226 (+ 3228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:18.453232 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:18.453232 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:18.453247 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:18.454976 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:18.455364 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:18.455367 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:18.455367 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:18.455452 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:18.455667 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:18.455668 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:18.455668 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:18.455882 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:18.455966 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:18.456364 (+ 398us) server_negotiation.cc:299] Negotiation successful
0618 23:22:18.456567 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":71,"threads_started":1}
W20260618 23:22:18.456885 18964 leader_election.cc:341] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61a60489bf8f41edba6e3ab271882e42 (127.3.217.131:41633): Not found: Tablet not found: cd30a0b6f70e4764be2191de87b67026
I20260618 23:22:18.457216 18890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd30a0b6f70e4764be2191de87b67026" candidate_uuid: "e044e4babc31486a92110e28b2d3caf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6954d5fbeb924beca053d78bfe642408" is_pre_election: true
I20260618 23:22:18.457374 18890 raft_consensus.cc:2454] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e044e4babc31486a92110e28b2d3caf9 in term 1.
I20260618 23:22:18.457666 18966 leader_election.cc:302] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6954d5fbeb924beca053d78bfe642408, e044e4babc31486a92110e28b2d3caf9; no voters: 61a60489bf8f41edba6e3ab271882e42
I20260618 23:22:18.457873 19218 raft_consensus.cc:2781] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260618 23:22:18.457937 19218 raft_consensus.cc:482] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:22:18.457968 19218 raft_consensus.cc:3037] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 1 FOLLOWER]: Advancing to term 2
I20260618 23:22:18.459189 19218 raft_consensus.cc:504] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:18.459343 19218 leader_election.cc:288] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [CANDIDATE]: Term 2 election: Requested vote from peers 61a60489bf8f41edba6e3ab271882e42 (127.3.217.131:41633), 6954d5fbeb924beca053d78bfe642408 (127.3.217.129:42863)
I20260618 23:22:18.459683 18890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd30a0b6f70e4764be2191de87b67026" candidate_uuid: "e044e4babc31486a92110e28b2d3caf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6954d5fbeb924beca053d78bfe642408"
W20260618 23:22:18.459694 18964 leader_election.cc:341] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 61a60489bf8f41edba6e3ab271882e42 (127.3.217.131:41633): Not found: Tablet not found: cd30a0b6f70e4764be2191de87b67026
I20260618 23:22:18.459781 18890 raft_consensus.cc:3037] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408 [term 1 FOLLOWER]: Advancing to term 2
I20260618 23:22:18.460829 18890 raft_consensus.cc:2454] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e044e4babc31486a92110e28b2d3caf9 in term 2.
I20260618 23:22:18.461198 18966 leader_election.cc:302] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6954d5fbeb924beca053d78bfe642408, e044e4babc31486a92110e28b2d3caf9; no voters: 61a60489bf8f41edba6e3ab271882e42
I20260618 23:22:18.461359 19218 raft_consensus.cc:2781] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 2 FOLLOWER]: Leader election won for term 2
I20260618 23:22:18.461517 19218 raft_consensus.cc:686] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [term 2 LEADER]: Becoming Leader. State: Replica: e044e4babc31486a92110e28b2d3caf9, State: Running, Role: LEADER
I20260618 23:22:18.461613 19218 consensus_queue.cc:237] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:18.461850 19220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:18.461750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.130:47121)
0618 23:22:18.461803 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:18.461827 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260618 23:22:18.886668 19225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:18.886406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.129:54005)
0618 23:22:18.886568 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:18.886612 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":79,"threads_started":1}
W20260618 23:22:18.919296 18964 consensus_peers.cc:487] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 -> Peer 61a60489bf8f41edba6e3ab271882e42 (127.3.217.131:41633): Couldn't send request to peer 61a60489bf8f41edba6e3ab271882e42. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cd30a0b6f70e4764be2191de87b67026. This is attempt 1: this message will repeat every 5th retry.
I20260618 23:22:18.986358 18890 raft_consensus.cc:1261] T cd30a0b6f70e4764be2191de87b67026 P 6954d5fbeb924beca053d78bfe642408 [term 2 FOLLOWER]: Refusing update from remote peer e044e4babc31486a92110e28b2d3caf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260618 23:22:18.986757 19218 consensus_queue.cc:1035] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260618 23:22:18.987982 19225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:18.987847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.129:45595)
0618 23:22:18.987910 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:18.987946 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260618 23:22:18.988739 19225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:18.988653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.129:35437)
0618 23:22:18.988683 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:18.988711 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
I20260618 23:22:18.988802 19231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:18.988480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.130:39783)
0618 23:22:18.988711 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:18.988748 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":52,"threads_started":1}
I20260618 23:22:19.063809 19232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:19.063597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.131:47249)
0618 23:22:19.063727 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:19.063765 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":60,"threads_started":1}
I20260618 23:22:19.463784 19233 ts_tablet_manager.cc:927] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42: Initiating tablet copy from peer e044e4babc31486a92110e28b2d3caf9 (127.3.217.130:41153)
I20260618 23:22:19.464083 19233 tablet_copy_client.cc:316] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42: tablet copy: Beginning tablet copy session from remote peer at address 127.3.217.130:41153
Jun 18 23:22:19 dist-test-slave-r9ct krb5kdc[17641](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824937, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for kudu/127.3.217.130@KRBTEST.COM
I20260618 23:22:19.473596 19235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:19.464500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:40961 (local address 127.3.217.130:41153)
0618 23:22:19.464658 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:19.464663 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:19.464672 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:22:19.464696 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:19.464697 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:19.464710 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:19.464799 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:19.465261 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:19.466063 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:19.467056 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:19.467371 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:19.467435 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:19.470350 (+ 2915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:19.470358 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:19.470358 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:19.470366 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:19.472095 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:19.472531 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:19.472534 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:19.472535 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:19.472642 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:19.472933 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:19.472934 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:19.472934 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:19.473124 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:19.473201 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:19.473402 (+ 201us) server_negotiation.cc:299] Negotiation successful
0618 23:22:19.473486 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":87,"threads_started":1}
I20260618 23:22:19.473604 19232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:19.464410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:41153 (local address 127.3.217.131:40961)
0618 23:22:19.464485 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:19.464502 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:19.464580 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:19.464820 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:19.464825 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:19.465082 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:19.465153 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:19.465155 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:19.466206 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:19.466206 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:19.466967 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:19.466970 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:19.467467 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:19.467468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:19.467527 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:19.468198 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:19.468286 (+ 88us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:19.470211 (+ 1925us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:19.472199 (+ 1988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:19.472205 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:19.472207 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:19.472438 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:19.472768 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:19.472769 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:19.472770 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:19.472857 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:19.473208 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:19.473214 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:19.473260 (+ 46us) client_negotiation.cc:769] Sending connection context
0618 23:22:19.473362 (+ 102us) client_negotiation.cc:240] Negotiation successful
0618 23:22:19.473486 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260618 23:22:19.474284 19052 tablet_copy_service.cc:140] P e044e4babc31486a92110e28b2d3caf9: Received BeginTabletCopySession request for tablet cd30a0b6f70e4764be2191de87b67026 from peer 61a60489bf8f41edba6e3ab271882e42 ({username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:40961)
I20260618 23:22:19.474376 19052 tablet_copy_service.cc:161] P e044e4babc31486a92110e28b2d3caf9: Beginning new tablet copy session on tablet cd30a0b6f70e4764be2191de87b67026 from peer 61a60489bf8f41edba6e3ab271882e42 at {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:40961: session id = 61a60489bf8f41edba6e3ab271882e42-cd30a0b6f70e4764be2191de87b67026
I20260618 23:22:19.475032 19052 tablet_copy_source_session.cc:205] T cd30a0b6f70e4764be2191de87b67026 P e044e4babc31486a92110e28b2d3caf9: Tablet Copy: opened 0 blocks and 1 log segments
I20260618 23:22:19.475916 19233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd30a0b6f70e4764be2191de87b67026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:19.478238 19233 tablet_copy_client.cc:791] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42: tablet copy: Starting download of 0 data blocks...
I20260618 23:22:19.478433 19233 tablet_copy_client.cc:655] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42: tablet copy: Starting download of 1 WAL segments...
I20260618 23:22:19.479389 19233 tablet_copy_client.cc:531] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260618 23:22:19.480041 19233 tablet_bootstrap.cc:492] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42: Bootstrap starting.
I20260618 23:22:19.481331 19233 log.cc:824] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:19.484817 19233 tablet_bootstrap.cc:492] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260618 23:22:19.485071 19233 tablet_bootstrap.cc:492] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42: Bootstrap complete.
I20260618 23:22:19.485277 19233 ts_tablet_manager.cc:1397] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260618 23:22:19.486341 19233 raft_consensus.cc:348] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:19.486519 19233 raft_consensus.cc:729] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61a60489bf8f41edba6e3ab271882e42, State: Initialized, Role: FOLLOWER
I20260618 23:22:19.486694 19233 consensus_queue.cc:260] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e044e4babc31486a92110e28b2d3caf9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 41153 } } peers { permanent_uuid: "61a60489bf8f41edba6e3ab271882e42" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41633 } } peers { permanent_uuid: "6954d5fbeb924beca053d78bfe642408" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 42863 } }
I20260618 23:22:19.487149 19233 ts_tablet_manager.cc:1428] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20260618 23:22:19.487586 19232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:19.487405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.131:48773)
0618 23:22:19.487495 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:19.487551 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260618 23:22:19.487779 19052 tablet_copy_service.cc:342] P e044e4babc31486a92110e28b2d3caf9: Request end of tablet copy session 61a60489bf8f41edba6e3ab271882e42-cd30a0b6f70e4764be2191de87b67026 received from {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:40961
I20260618 23:22:19.487974 19052 tablet_copy_service.cc:433] P e044e4babc31486a92110e28b2d3caf9: ending tablet copy session 61a60489bf8f41edba6e3ab271882e42-cd30a0b6f70e4764be2191de87b67026 on tablet cd30a0b6f70e4764be2191de87b67026 with peer 61a60489bf8f41edba6e3ab271882e42
I20260618 23:22:19.487985 19232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:19.487867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.131:55611)
0618 23:22:19.487918 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:19.487942 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260618 23:22:19.851965 19165 raft_consensus.cc:1203] T cd30a0b6f70e4764be2191de87b67026 P 61a60489bf8f41edba6e3ab271882e42 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 1.2->[2.3-2.3] Dedup: 2.3->[]
I20260618 23:22:19.852015 19239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:19.851787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.130:44521)
0618 23:22:19.851891 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:19.851960 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":59,"threads_started":1}
I20260618 23:22:19.852444 19232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:19.852345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.131:39225)
0618 23:22:19.852383 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:19.852418 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260618 23:22:19.989384 19240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:19.989203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.129:45923)
0618 23:22:19.989307 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:19.989343 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":48,"threads_started":1}
I20260618 23:22:20.852814 19241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:20.852504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.130:34743)
0618 23:22:20.852693 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:20.852746 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":66,"threads_started":1}
I20260618 23:22:20.853025 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:20.852807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.131:49139)
0618 23:22:20.852946 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:20.852980 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":98,"threads_started":1}
I20260618 23:22:20.990075 19244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:20.989835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.129:58007)
0618 23:22:20.989983 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:20.990021 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":80,"threads_started":1}
I20260618 23:22:21.853796 19245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:21.853485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.130:37453)
0618 23:22:21.853687 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:21.853734 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":138,"threads_started":1}
I20260618 23:22:21.854043 19246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:21.853540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.131:55317)
0618 23:22:21.853735 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:21.853966 (+ 231us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":157,"threads_started":1}
I20260618 23:22:21.990947 19247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:21.990694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.129:41657)
0618 23:22:21.990863 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:21.990901 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":126,"threads_started":1}
I20260618 23:22:22.854839 19248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:22.854393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.130:48647)
0618 23:22:22.854667 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:22.854770 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":81,"threads_started":1}
I20260618 23:22:22.855310 19249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:22.854891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.131:56007)
0618 23:22:22.855145 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:22.855207 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":76,"threads_started":1}
I20260618 23:22:22.991744 19250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:22.991526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.129:45911)
0618 23:22:22.991652 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:22.991696 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":63,"threads_started":1}
I20260618 23:22:23.855741 19251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:23.855434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.130:37119)
0618 23:22:23.855595 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:23.855638 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":62,"threads_started":1}
I20260618 23:22:23.856076 19252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:23.855814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.131:37041)
0618 23:22:23.855987 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:23.856039 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":77,"threads_started":1}
I20260618 23:22:23.992638 19253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:23.992394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.129:33709)
0618 23:22:23.992543 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:23.992590 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":60,"threads_started":1}
I20260618 23:22:24.856796 19254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:24.856471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.130:39547)
0618 23:22:24.856674 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:24.856732 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":140,"threads_started":1}
I20260618 23:22:24.856855 19255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:24.856630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.131:59229)
0618 23:22:24.856769 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:24.856810 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":94,"threads_started":1}
I20260618 23:22:24.993391 19256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:24.993171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.129:46027)
0618 23:22:24.993304 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:24.993344 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":58,"threads_started":1}
I20260618 23:22:25.857709 19258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:25.857518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.131:42191)
0618 23:22:25.857627 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:25.857659 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":66,"threads_started":1}
I20260618 23:22:25.857709 19257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:25.857463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.130:45131)
0618 23:22:25.857595 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:25.857650 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":88,"threads_started":1}
I20260618 23:22:25.994174 19259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:25.993947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.129:43871)
0618 23:22:25.994089 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:25.994125 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":74,"threads_started":1}
I20260618 23:22:26.858417 19261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:26.858240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.130:57899)
0618 23:22:26.858350 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:26.858379 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":43,"threads_started":1}
I20260618 23:22:26.858412 19260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:26.858200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.131:50407)
0618 23:22:26.858331 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:26.858369 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":75,"threads_started":1}
I20260618 23:22:26.995138 19262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:26.994856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.129:41575)
0618 23:22:26.995015 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:26.995059 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":82,"threads_started":1}
I20260618 23:22:27.859197 19264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:27.858962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.131:43101)
0618 23:22:27.859115 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:27.859149 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":77,"threads_started":1}
I20260618 23:22:27.859198 19263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:27.858951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.130:42445)
0618 23:22:27.859124 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:27.859160 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":64,"threads_started":1}
I20260618 23:22:27.995832 19265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:27.995613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.129:53495)
0618 23:22:27.995749 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:27.995786 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":57,"threads_started":1}
I20260618 23:22:28.859957 19266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:28.859729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.131:53719)
0618 23:22:28.859881 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:28.859913 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":98,"threads_started":1}
I20260618 23:22:28.859982 19267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:28.859791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.130:60115)
0618 23:22:28.859914 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:28.859944 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":72,"threads_started":1}
I20260618 23:22:28.996835 19268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:28.996400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.129:54405)
0618 23:22:28.996656 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:28.996755 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":64,"threads_started":1}
I20260618 23:22:29.860814 19269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:29.860514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.131:56371)
0618 23:22:29.860703 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:29.860758 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":86,"threads_started":1}
I20260618 23:22:29.860842 19270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:29.860576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.130:46043)
0618 23:22:29.860764 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:29.860802 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":113,"threads_started":1}
I20260618 23:22:29.997716 19271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:29.997497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.129:58403)
0618 23:22:29.997629 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:29.997664 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":60,"threads_started":1}
I20260618 23:22:30.861580 19272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:30.861357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.131:42289)
0618 23:22:30.861499 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:30.861536 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":73,"threads_started":1}
I20260618 23:22:30.861632 19273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:30.861357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.130:39943)
0618 23:22:30.861555 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:30.861593 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":76,"threads_started":1}
I20260618 23:22:30.998607 19274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:30.998231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.129:50481)
0618 23:22:30.998461 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:30.998535 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":76,"threads_started":1}
I20260618 23:22:31.862448 19275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:31.862163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.131:40981)
0618 23:22:31.862323 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:31.862391 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":70,"threads_started":1}
I20260618 23:22:31.862469 19276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:31.862273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.130:51887)
0618 23:22:31.862391 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:31.862426 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":64,"threads_started":1}
I20260618 23:22:31.999522 19277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:31.999225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33165 (local address 127.3.217.129:58901)
0618 23:22:31.999433 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:31.999473 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":90,"threads_started":1}
I20260618 23:22:32.078742 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 18783
I20260618 23:22:32.083637 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 18946
I20260618 23:22:32.088146 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 19082
2026-06-18T23:22:32Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18403 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:22:32 dist-test-slave-r9ct krb5kdc[19280](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:22:32 dist-test-slave-r9ct krb5kdc[19280](info): set up 2 sockets
Jun 18 23:22:32 dist-test-slave-r9ct krb5kdc[19280](info): commencing operation
krb5kdc: starting...
W20260618 23:22:33.139343 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.030s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:22:33 dist-test-slave-r9ct krb5kdc[19280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824953, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:22:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:22:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:22:33.262115 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:37653
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:38745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:37653
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:22:33.344888 19293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:33.345162 19293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:33.345221 19293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:33.346704 19293 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260618 23:22:33.346813 19293 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260618 23:22:33.346838 19293 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260618 23:22:33.346859 19293 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:22:33.346891 19293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:33.346928 19293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:33.346956 19293 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:22:33.346992 19293 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:22:33.348659 19293 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:38745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:37653
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:37653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19293
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:33.348965 19293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:33.349224 19293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:33.354969 19299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:33.355095 19293 server_base.cc:1034] running on GCE node
W20260618 23:22:33.354996 19301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:33.355003 19298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:33.355448 19293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:33.355695 19293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:33.356880 19293 hybrid_clock.cc:648] HybridClock initialized: now 1781824953356854 us; error 48 us; skew 500 ppm
Jun 18 23:22:33 dist-test-slave-r9ct krb5kdc[19280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824953, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:33.359494 19293 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:22:33.359942 19293 webserver.cc:460] Webserver started at http://127.3.217.190:45635/ using document root <none> and password file <none>
I20260618 23:22:33.360198 19293 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:33.360270 19293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:33.360402 19293 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:22:33.361444 19293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "6411182249714edf99af8f7055968737"
format_stamp: "Formatted at 2026-06-18 23:22:33 on dist-test-slave-r9ct"
server_key: "fdafc0ca7e65472b614763de85e60ed7"
server_key_iv: "86e63c2691c3b01b6144a6b3b7c63c4e"
server_key_version: "encryptionkey@0"
I20260618 23:22:33.361802 19293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "6411182249714edf99af8f7055968737"
format_stamp: "Formatted at 2026-06-18 23:22:33 on dist-test-slave-r9ct"
server_key: "fdafc0ca7e65472b614763de85e60ed7"
server_key_iv: "86e63c2691c3b01b6144a6b3b7c63c4e"
server_key_version: "encryptionkey@0"
I20260618 23:22:33.363440 19293 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260618 23:22:33.364367 19308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:33.364610 19293 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:22:33.364715 19293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "6411182249714edf99af8f7055968737"
format_stamp: "Formatted at 2026-06-18 23:22:33 on dist-test-slave-r9ct"
server_key: "fdafc0ca7e65472b614763de85e60ed7"
server_key_iv: "86e63c2691c3b01b6144a6b3b7c63c4e"
server_key_version: "encryptionkey@0"
I20260618 23:22:33.364815 19293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:33.403195 19293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:33.406145 19293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:33.406380 19293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:33.410552 19293 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:37653
I20260618 23:22:33.410607 19360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:37653 every 8 connection(s)
I20260618 23:22:33.410995 19293 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:22:33.411890 19361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:33.414319 19361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737: Bootstrap starting.
I20260618 23:22:33.415321 19361 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737: Neither blocks nor log segments found. Creating new log.
I20260618 23:22:33.415824 19361 log.cc:824] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:33.416540 19361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737: No bootstrap required, opened a new log
I20260618 23:22:33.418190 19361 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6411182249714edf99af8f7055968737" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37653 } }
I20260618 23:22:33.418334 19361 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:22:33.418357 19361 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6411182249714edf99af8f7055968737, State: Initialized, Role: FOLLOWER
I20260618 23:22:33.418533 19361 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6411182249714edf99af8f7055968737" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37653 } }
I20260618 23:22:33.418622 19361 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:22:33.418659 19361 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:22:33.418758 19361 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:22:33.418762 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 19293
I20260618 23:22:33.418900 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:22:33.419127 3942 external_mini_cluster.cc:1428] Setting key d785eae0544f6d014b6d49f4afcc24fd
I20260618 23:22:33.419580 19361 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6411182249714edf99af8f7055968737" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37653 } }
I20260618 23:22:33.419718 19361 leader_election.cc:302] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6411182249714edf99af8f7055968737; no voters:
I20260618 23:22:33.419880 19361 leader_election.cc:288] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:22:33.420168 19361 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:22:33.420317 19367 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:22:33.420485 19367 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 1 LEADER]: Becoming Leader. State: Replica: 6411182249714edf99af8f7055968737, State: Running, Role: LEADER
I20260618 23:22:33.420612 19367 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6411182249714edf99af8f7055968737" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37653 } }
I20260618 23:22:33.421029 19367 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6411182249714edf99af8f7055968737" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6411182249714edf99af8f7055968737" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37653 } } }
I20260618 23:22:33.421160 19367 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [sys.catalog]: This master's current role is: LEADER
I20260618 23:22:33.421344 19367 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6411182249714edf99af8f7055968737. Latest consensus state: current_term: 1 leader_uuid: "6411182249714edf99af8f7055968737" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6411182249714edf99af8f7055968737" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37653 } } }
I20260618 23:22:33.421465 19367 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [sys.catalog]: This master's current role is: LEADER
I20260618 23:22:33.421640 19377 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:22:33.422183 19377 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:22:33.423746 19377 catalog_manager.cc:1347] Generated new cluster ID: ba811f21f807407a86c1447f5ab34667
I20260618 23:22:33.423799 19377 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 18 23:22:33 dist-test-slave-r9ct krb5kdc[19280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824953, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:33.431818 19365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:33.419641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53902 (local address 127.3.217.190:37653)
0618 23:22:33.420120 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:33.420130 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:33.420165 (+ 35us) server_negotiation.cc:407] Connection header received
0618 23:22:33.420283 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:33.420289 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:33.420389 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:33.421344 (+ 955us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:33.421454 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.423160 (+ 1706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.424167 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.424737 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.424839 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:33.427653 (+ 2814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:33.427658 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:33.427659 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:33.427670 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:33.430184 (+ 2514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:33.430564 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:33.430567 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:33.430567 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:33.430672 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:33.430915 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:33.430916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:33.430917 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:33.431223 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:33.431377 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:33.431450 (+ 73us) server_negotiation.cc:299] Negotiation successful
0618 23:22:33.431583 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":121,"threads_started":1}
I20260618 23:22:33.437595 19377 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:22:33.438308 19377 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:22:33.448308 19377 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737: Generated new TSK 0
I20260618 23:22:33.448485 19377 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.217.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
I20260618 23:22:33.482589 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:37653
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:38745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:22:33.567672 19387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:33.567888 19387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:33.567914 19387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:33.569134 19387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:33.569212 19387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:33.569242 19387 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:22:33.570657 19387 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:38745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:37653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19387
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:33.570962 19387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:33.571218 19387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:33.576221 19392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:33.576241 19393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:33.576511 19387 server_base.cc:1034] running on GCE node
W20260618 23:22:33.576241 19395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:33.576761 19387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:33.576999 19387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:33.578140 19387 hybrid_clock.cc:648] HybridClock initialized: now 1781824953578119 us; error 48 us; skew 500 ppm
Jun 18 23:22:33 dist-test-slave-r9ct krb5kdc[19280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824953, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:33.580588 19387 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:22:33.581019 19387 webserver.cc:460] Webserver started at http://127.3.217.129:37049/ using document root <none> and password file <none>
I20260618 23:22:33.581193 19387 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:33.581233 19387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:33.581319 19387 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:22:33.582273 19387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "c2f459636e544ed48ec579a26d25ac36"
format_stamp: "Formatted at 2026-06-18 23:22:33 on dist-test-slave-r9ct"
server_key: "cf8ba9ae4757f82484a60e0f8f93e3b3"
server_key_iv: "ad87a3a812c8ed4964400a8df7a843d3"
server_key_version: "encryptionkey@0"
I20260618 23:22:33.582561 19387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "c2f459636e544ed48ec579a26d25ac36"
format_stamp: "Formatted at 2026-06-18 23:22:33 on dist-test-slave-r9ct"
server_key: "cf8ba9ae4757f82484a60e0f8f93e3b3"
server_key_iv: "ad87a3a812c8ed4964400a8df7a843d3"
server_key_version: "encryptionkey@0"
I20260618 23:22:33.583900 19387 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:22:33.584817 19402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:33.585299 19387 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:33.585395 19387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "c2f459636e544ed48ec579a26d25ac36"
format_stamp: "Formatted at 2026-06-18 23:22:33 on dist-test-slave-r9ct"
server_key: "cf8ba9ae4757f82484a60e0f8f93e3b3"
server_key_iv: "ad87a3a812c8ed4964400a8df7a843d3"
server_key_version: "encryptionkey@0"
I20260618 23:22:33.585496 19387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:33.597038 19387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:33.599294 19387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:33.599447 19387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:33.599691 19387 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:22:33.600016 19387 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:22:33.600085 19387 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:33.600131 19387 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:22:33.600157 19387 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:33.606690 19387 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:45297
I20260618 23:22:33.606798 19515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:45297 every 8 connection(s)
I20260618 23:22:33.607120 19387 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:22:33.607663 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 19387
I20260618 23:22:33.607780 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:22:33.608006 3942 external_mini_cluster.cc:1428] Setting key e5a183846d7dd20eae8c2425a5b9c999
Jun 18 23:22:33 dist-test-slave-r9ct krb5kdc[19280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824953, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.3.217.130@KRBTEST.COM; defaulting to no policy
I20260618 23:22:33.618450 19365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:33.607892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:59795 (local address 127.3.217.190:37653)
0618 23:22:33.607941 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:33.607943 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:33.608239 (+ 296us) server_negotiation.cc:407] Connection header received
0618 23:22:33.608890 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:33.608891 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:33.608904 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:33.608955 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:33.609911 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.610537 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.611599 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.611940 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.612012 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:33.614987 (+ 2975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:33.614989 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:33.614990 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:33.615002 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:33.616844 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:33.617387 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:33.617389 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:33.617389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:33.617447 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:33.617721 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:33.617722 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:33.617723 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:33.617863 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:33.617961 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:33.618254 (+ 293us) server_negotiation.cc:299] Negotiation successful
0618 23:22:33.618353 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260618 23:22:33.618646 19518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:33.607907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.129:59795)
0618 23:22:33.608089 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:33.608137 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:33.608792 (+ 655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:33.609022 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:33.609025 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:33.609594 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:33.609792 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:33.609796 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.610650 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.610650 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:33.611503 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:33.611505 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.612035 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.612036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:33.612138 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:33.612721 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:33.612731 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:33.614859 (+ 2128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:33.616945 (+ 2086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:33.616951 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:33.616953 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:33.617262 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:33.617527 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:33.617528 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:33.617528 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:33.617641 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:33.617952 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:33.617959 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:33.618104 (+ 145us) client_negotiation.cc:769] Sending connection context
0618 23:22:33.618219 (+ 115us) client_negotiation.cc:240] Negotiation successful
0618 23:22:33.618390 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":87,"threads_started":1}
I20260618 23:22:33.619218 19516 heartbeater.cc:347] Connected to a master server at 127.3.217.190:37653
I20260618 23:22:33.619419 19516 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:33.619597 19516 heartbeater.cc:511] Master 127.3.217.190:37653 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.130@KRBTEST.COM" created.
I20260618 23:22:33.620204 19325 ts_manager.cc:194] Registered new tserver with Master: c2f459636e544ed48ec579a26d25ac36 (127.3.217.129:45297)
I20260618 23:22:33.621156 19325 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:59795
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
I20260618 23:22:33.638661 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:37653
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:38745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:22:33.722836 19521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:33.723037 19521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:33.723059 19521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:33.724167 19521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:33.724217 19521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:33.724243 19521 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:22:33.725652 19521 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:38745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:37653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:33.725885 19521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:33.726145 19521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:33.731598 19529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:33.731619 19527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:33.731717 19526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:33.732010 19521 server_base.cc:1034] running on GCE node
I20260618 23:22:33.732282 19521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:33.732534 19521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:33.733716 19521 hybrid_clock.cc:648] HybridClock initialized: now 1781824953733689 us; error 44 us; skew 500 ppm
Jun 18 23:22:33 dist-test-slave-r9ct krb5kdc[19280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824953, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:33.736570 19521 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:22:33.737298 19521 webserver.cc:460] Webserver started at http://127.3.217.130:43095/ using document root <none> and password file <none>
I20260618 23:22:33.737633 19521 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:33.737728 19521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:33.737921 19521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:22:33.739437 19521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "a09ef6e3f59e4f68847129aed9e2e9a9"
format_stamp: "Formatted at 2026-06-18 23:22:33 on dist-test-slave-r9ct"
server_key: "8935bc5649487b24ee87be949fd2453c"
server_key_iv: "7bb37d3b2e3ec4721233a0b9f2ffd2d7"
server_key_version: "encryptionkey@0"
I20260618 23:22:33.739985 19521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "a09ef6e3f59e4f68847129aed9e2e9a9"
format_stamp: "Formatted at 2026-06-18 23:22:33 on dist-test-slave-r9ct"
server_key: "8935bc5649487b24ee87be949fd2453c"
server_key_iv: "7bb37d3b2e3ec4721233a0b9f2ffd2d7"
server_key_version: "encryptionkey@0"
I20260618 23:22:33.741472 19521 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260618 23:22:33.742409 19536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:33.742635 19521 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:33.742789 19521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "a09ef6e3f59e4f68847129aed9e2e9a9"
format_stamp: "Formatted at 2026-06-18 23:22:33 on dist-test-slave-r9ct"
server_key: "8935bc5649487b24ee87be949fd2453c"
server_key_iv: "7bb37d3b2e3ec4721233a0b9f2ffd2d7"
server_key_version: "encryptionkey@0"
I20260618 23:22:33.742873 19521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:33.768519 19521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:33.771099 19521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:33.771220 19521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:33.771415 19521 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:22:33.771749 19521 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:22:33.771783 19521 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:33.771807 19521 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:22:33.771862 19521 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:33.778142 19521 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:36205
I20260618 23:22:33.778183 19649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:36205 every 8 connection(s)
I20260618 23:22:33.778553 19521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:22:33.784591 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 19521
I20260618 23:22:33.784708 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:22:33.784909 3942 external_mini_cluster.cc:1428] Setting key a31f967c6362510ec4ad94beb5f86f16
Jun 18 23:22:33 dist-test-slave-r9ct krb5kdc[19280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824953, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:33.788923 19365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:33.779371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:39513 (local address 127.3.217.190:37653)
0618 23:22:33.779457 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:33.779460 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:33.779623 (+ 163us) server_negotiation.cc:407] Connection header received
0618 23:22:33.780163 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:33.780164 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:33.780176 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:33.780232 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:33.781384 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.781902 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.782975 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.783182 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.783273 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:33.785982 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:33.785984 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:33.785985 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:33.785992 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:33.787487 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:33.787919 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:33.787921 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:33.787922 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:33.787980 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:33.788248 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:33.788249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:33.788250 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:33.788402 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:33.788480 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:33.788750 (+ 270us) server_negotiation.cc:299] Negotiation successful
0618 23:22:33.788831 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260618 23:22:33.789145 19652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:33.779262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.130:39513)
0618 23:22:33.779493 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:33.779536 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:33.780053 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:33.780363 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:33.780366 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:33.780916 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:33.781102 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:33.781106 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.782021 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.782022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:33.782878 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:33.782880 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.783281 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.783282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:33.783403 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:33.783955 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:33.783964 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:33.785861 (+ 1897us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:33.787591 (+ 1730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:33.787598 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:33.787601 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:33.787827 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:33.788047 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:33.788048 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:33.788049 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:33.788163 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:33.788471 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:33.788478 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:33.788617 (+ 139us) client_negotiation.cc:769] Sending connection context
0618 23:22:33.788725 (+ 108us) client_negotiation.cc:240] Negotiation successful
0618 23:22:33.788885 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":112,"threads_started":1}
I20260618 23:22:33.789608 19650 heartbeater.cc:347] Connected to a master server at 127.3.217.190:37653
I20260618 23:22:33.789883 19650 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:33.790254 19650 heartbeater.cc:511] Master 127.3.217.190:37653 requested a full tablet report, sending...
I20260618 23:22:33.790781 19325 ts_manager.cc:194] Registered new tserver with Master: a09ef6e3f59e4f68847129aed9e2e9a9 (127.3.217.130:36205)
I20260618 23:22:33.791163 19325 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:39513
WARNING: no policy specified for kudu/127.3.217.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
I20260618 23:22:33.818471 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:37653
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:38745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:22:33.903810 19655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:33.904050 19655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:33.904078 19655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:33.905417 19655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:33.905462 19655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:33.905490 19655 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:22:33.907090 19655 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:38745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:37653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:33.907294 19655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:33.907550 19655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:33.913020 19663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:33.913029 19661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:33.913034 19660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:33.913079 19655 server_base.cc:1034] running on GCE node
I20260618 23:22:33.913436 19655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:33.913641 19655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:33.914770 19655 hybrid_clock.cc:648] HybridClock initialized: now 1781824953914740 us; error 46 us; skew 500 ppm
Jun 18 23:22:33 dist-test-slave-r9ct krb5kdc[19280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824953, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:33.917181 19655 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:22:33.917586 19655 webserver.cc:460] Webserver started at http://127.3.217.131:41533/ using document root <none> and password file <none>
I20260618 23:22:33.917805 19655 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:33.917873 19655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:33.918020 19655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:22:33.919078 19655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "916ba07e6d814ce0b367c877761479a8"
format_stamp: "Formatted at 2026-06-18 23:22:33 on dist-test-slave-r9ct"
server_key: "0c9c1ca5e28c3e323a246c0c3a227696"
server_key_iv: "be65de8f255264c1a1db283e5b7d9fdb"
server_key_version: "encryptionkey@0"
I20260618 23:22:33.919420 19655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "916ba07e6d814ce0b367c877761479a8"
format_stamp: "Formatted at 2026-06-18 23:22:33 on dist-test-slave-r9ct"
server_key: "0c9c1ca5e28c3e323a246c0c3a227696"
server_key_iv: "be65de8f255264c1a1db283e5b7d9fdb"
server_key_version: "encryptionkey@0"
I20260618 23:22:33.920938 19655 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260618 23:22:33.921936 19670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:33.922176 19655 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:33.922271 19655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "916ba07e6d814ce0b367c877761479a8"
format_stamp: "Formatted at 2026-06-18 23:22:33 on dist-test-slave-r9ct"
server_key: "0c9c1ca5e28c3e323a246c0c3a227696"
server_key_iv: "be65de8f255264c1a1db283e5b7d9fdb"
server_key_version: "encryptionkey@0"
I20260618 23:22:33.922364 19655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:33.932951 19655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:33.935490 19655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:33.935648 19655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:33.935879 19655 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:22:33.936187 19655 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:22:33.936219 19655 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:33.936241 19655 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:22:33.936287 19655 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:33.942138 19655 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:41939
I20260618 23:22:33.942222 19783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:41939 every 8 connection(s)
I20260618 23:22:33.942529 19655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:22:33.944569 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 19655
I20260618 23:22:33.944697 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:22:33.944886 3942 external_mini_cluster.cc:1428] Setting key 26b6368fc8a61418100e462610085cbc
Jun 18 23:22:33 dist-test-slave-r9ct krb5kdc[19280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824953, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:33.952575 19365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:33.943468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:41481 (local address 127.3.217.190:37653)
0618 23:22:33.943561 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:33.943563 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:33.943748 (+ 185us) server_negotiation.cc:407] Connection header received
0618 23:22:33.944411 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:33.944413 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:33.944427 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:33.944503 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:33.945744 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.946286 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.947378 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.947565 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.947652 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:33.949787 (+ 2135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:33.949788 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:33.949789 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:33.949795 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:33.951204 (+ 1409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:33.951626 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:33.951628 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:33.951628 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:33.951690 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:33.951962 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:33.951963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:33.951963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:33.952074 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:33.952147 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:33.952412 (+ 265us) server_negotiation.cc:299] Negotiation successful
0618 23:22:33.952486 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260618 23:22:33.952780 19786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:33.943269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.131:41481)
0618 23:22:33.943562 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:33.943627 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:33.944244 (+ 617us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:33.944619 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:33.944624 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:33.945390 (+ 766us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:33.945667 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:33.945673 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.946379 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.946380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:33.947274 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:33.947277 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.947675 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.947677 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:33.947800 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:33.948305 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:33.948315 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:33.949660 (+ 1345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:33.951299 (+ 1639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:33.951305 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:33.951307 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:33.951534 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:33.951762 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:33.951763 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:33.951763 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:33.951879 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:33.952151 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:33.952157 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:33.952286 (+ 129us) client_negotiation.cc:769] Sending connection context
0618 23:22:33.952390 (+ 104us) client_negotiation.cc:240] Negotiation successful
0618 23:22:33.952540 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":91,"threads_started":1}
I20260618 23:22:33.953347 19784 heartbeater.cc:347] Connected to a master server at 127.3.217.190:37653
I20260618 23:22:33.953435 19784 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:33.953620 19784 heartbeater.cc:511] Master 127.3.217.190:37653 requested a full tablet report, sending...
I20260618 23:22:33.954095 19325 ts_manager.cc:194] Registered new tserver with Master: 916ba07e6d814ce0b367c877761479a8 (127.3.217.131:41939)
I20260618 23:22:33.954514 19325 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:41481
I20260618 23:22:33.956647 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260618 23:22:33.964391 19365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:33.957951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55308 (local address 127.3.217.190:37653)
0618 23:22:33.958020 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:33.958022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:33.958191 (+ 169us) server_negotiation.cc:407] Connection header received
0618 23:22:33.958221 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:33.958222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:33.958231 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:33.958305 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:33.959157 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.959681 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.960399 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.960571 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.960626 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:33.961737 (+ 1111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:33.961738 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:33.961738 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:33.961744 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:33.963173 (+ 1429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:33.963538 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:33.963539 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:33.963539 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:33.963593 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:33.963836 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:33.963837 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:33.963837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:33.963996 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:33.964090 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:33.964261 (+ 171us) server_negotiation.cc:299] Negotiation successful
0618 23:22:33.964322 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260618 23:22:33.966107 19325 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55308:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:22:33.967811 19325 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:22:33.974789 19795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:33.970379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:45297 (local address 127.0.0.1:59248)
0618 23:22:33.971328 (+ 949us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:33.971338 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:33.971389 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:33.971584 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:33.971585 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:33.971588 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:33.971627 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:33.971628 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.972863 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.972864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:33.973780 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:33.973783 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.974439 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.974440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:33.974515 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:33.974529 (+ 14us) client_negotiation.cc:769] Sending connection context
0618 23:22:33.974626 (+ 97us) client_negotiation.cc:240] Negotiation successful
0618 23:22:33.974679 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":936,"mutex_wait_us":3,"spinlock_wait_cycles":384,"thread_start_us":92,"threads_started":1}
I20260618 23:22:33.974799 19799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:33.970647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59248 (local address 127.3.217.129:45297)
0618 23:22:33.971141 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:33.971146 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:33.971449 (+ 303us) server_negotiation.cc:407] Connection header received
0618 23:22:33.971491 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:33.971494 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:33.971510 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:33.971585 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:33.971691 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.972734 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.973866 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.974352 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.974439 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:33.974496 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:33.974645 (+ 149us) server_negotiation.cc:299] Negotiation successful
0618 23:22:33.974686 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":261,"threads_started":1}
I20260618 23:22:33.975013 19796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:33.970379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:36205 (local address 127.0.0.1:58886)
0618 23:22:33.970954 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:33.970963 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:33.971011 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:33.971326 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:33.971327 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:33.971328 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:33.971378 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:33.971381 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.972660 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.972661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:33.973841 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:33.973843 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.974772 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.974773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:33.974839 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:33.974843 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:22:33.974873 (+ 30us) client_negotiation.cc:240] Negotiation successful
0618 23:22:33.974917 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"mutex_wait_us":23,"thread_start_us":98,"threads_started":1}
I20260618 23:22:33.975143 19797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:33.970376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:41939 (local address 127.0.0.1:58626)
0618 23:22:33.970530 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:33.970582 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:33.970650 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:33.971071 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:33.971073 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:33.971076 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:33.971140 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:33.971143 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.972329 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.972330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:33.973832 (+ 1502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:33.973835 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.974823 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.974824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:33.974892 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:33.974895 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:22:33.974938 (+ 43us) client_negotiation.cc:240] Negotiation successful
0618 23:22:33.974970 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":21,"thread_start_us":56,"threads_started":1}
I20260618 23:22:33.975230 19800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:33.970873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58886 (local address 127.3.217.130:36205)
0618 23:22:33.971056 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:33.971083 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:33.971092 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:22:33.971128 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:33.971130 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:33.971144 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:33.971248 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:33.971459 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.972547 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.973935 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.974637 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.975011 (+ 374us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:33.975073 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:33.975099 (+ 26us) server_negotiation.cc:299] Negotiation successful
0618 23:22:33.975140 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":78,"threads_started":1}
I20260618 23:22:33.975451 19798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:33.970638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58626 (local address 127.3.217.131:41939)
0618 23:22:33.970818 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:33.970822 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:33.970834 (+ 12us) server_negotiation.cc:407] Connection header received
0618 23:22:33.970885 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:33.970887 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:33.970904 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:33.970993 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:33.971211 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.972202 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.973934 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:33.974660 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:33.974744 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:33.974795 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:33.975312 (+ 517us) server_negotiation.cc:299] Negotiation successful
0618 23:22:33.975356 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":108,"threads_started":1}
I20260618 23:22:33.975790 19450 tablet_service.cc:1467] Processing CreateTablet for tablet 339377ab818d44008eba0815673d9630 (DEFAULT_TABLE table=test-table [id=95110911550c4020994c72807183e5ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:22:33.975837 19584 tablet_service.cc:1467] Processing CreateTablet for tablet 339377ab818d44008eba0815673d9630 (DEFAULT_TABLE table=test-table [id=95110911550c4020994c72807183e5ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:22:33.976050 19450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 339377ab818d44008eba0815673d9630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:33.976068 19584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 339377ab818d44008eba0815673d9630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:33.978534 19801 tablet_bootstrap.cc:492] T 339377ab818d44008eba0815673d9630 P a09ef6e3f59e4f68847129aed9e2e9a9: Bootstrap starting.
I20260618 23:22:33.979091 19718 tablet_service.cc:1467] Processing CreateTablet for tablet 339377ab818d44008eba0815673d9630 (DEFAULT_TABLE table=test-table [id=95110911550c4020994c72807183e5ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:22:33.979313 19801 tablet_bootstrap.cc:654] T 339377ab818d44008eba0815673d9630 P a09ef6e3f59e4f68847129aed9e2e9a9: Neither blocks nor log segments found. Creating new log.
I20260618 23:22:33.979414 19718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 339377ab818d44008eba0815673d9630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:33.979466 19802 tablet_bootstrap.cc:492] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36: Bootstrap starting.
I20260618 23:22:33.979889 19801 log.cc:824] T 339377ab818d44008eba0815673d9630 P a09ef6e3f59e4f68847129aed9e2e9a9: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:33.980070 19802 tablet_bootstrap.cc:654] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36: Neither blocks nor log segments found. Creating new log.
I20260618 23:22:33.980690 19801 tablet_bootstrap.cc:492] T 339377ab818d44008eba0815673d9630 P a09ef6e3f59e4f68847129aed9e2e9a9: No bootstrap required, opened a new log
I20260618 23:22:33.980774 19801 ts_tablet_manager.cc:1397] T 339377ab818d44008eba0815673d9630 P a09ef6e3f59e4f68847129aed9e2e9a9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:22:33.980911 19802 log.cc:824] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:33.981932 19802 tablet_bootstrap.cc:492] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36: No bootstrap required, opened a new log
I20260618 23:22:33.982000 19802 ts_tablet_manager.cc:1397] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260618 23:22:33.982445 19801 raft_consensus.cc:348] T 339377ab818d44008eba0815673d9630 P a09ef6e3f59e4f68847129aed9e2e9a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } }
I20260618 23:22:33.982601 19801 raft_consensus.cc:374] T 339377ab818d44008eba0815673d9630 P a09ef6e3f59e4f68847129aed9e2e9a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:22:33.982643 19801 raft_consensus.cc:729] T 339377ab818d44008eba0815673d9630 P a09ef6e3f59e4f68847129aed9e2e9a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09ef6e3f59e4f68847129aed9e2e9a9, State: Initialized, Role: FOLLOWER
I20260618 23:22:33.982791 19801 consensus_queue.cc:260] T 339377ab818d44008eba0815673d9630 P a09ef6e3f59e4f68847129aed9e2e9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } }
I20260618 23:22:33.983052 19801 ts_tablet_manager.cc:1428] T 339377ab818d44008eba0815673d9630 P a09ef6e3f59e4f68847129aed9e2e9a9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260618 23:22:33.983183 19650 heartbeater.cc:503] Master 127.3.217.190:37653 was elected leader, sending a full tablet report...
I20260618 23:22:33.983563 19806 tablet_bootstrap.cc:492] T 339377ab818d44008eba0815673d9630 P 916ba07e6d814ce0b367c877761479a8: Bootstrap starting.
I20260618 23:22:33.984211 19806 tablet_bootstrap.cc:654] T 339377ab818d44008eba0815673d9630 P 916ba07e6d814ce0b367c877761479a8: Neither blocks nor log segments found. Creating new log.
I20260618 23:22:33.984213 19802 raft_consensus.cc:348] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } }
I20260618 23:22:33.984423 19802 raft_consensus.cc:374] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:22:33.984472 19802 raft_consensus.cc:729] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2f459636e544ed48ec579a26d25ac36, State: Initialized, Role: FOLLOWER
I20260618 23:22:33.984579 19802 consensus_queue.cc:260] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } }
I20260618 23:22:33.984711 19806 log.cc:824] T 339377ab818d44008eba0815673d9630 P 916ba07e6d814ce0b367c877761479a8: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:33.984855 19802 ts_tablet_manager.cc:1428] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260618 23:22:33.984866 19516 heartbeater.cc:503] Master 127.3.217.190:37653 was elected leader, sending a full tablet report...
I20260618 23:22:33.985492 19806 tablet_bootstrap.cc:492] T 339377ab818d44008eba0815673d9630 P 916ba07e6d814ce0b367c877761479a8: No bootstrap required, opened a new log
I20260618 23:22:33.985581 19806 ts_tablet_manager.cc:1397] T 339377ab818d44008eba0815673d9630 P 916ba07e6d814ce0b367c877761479a8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:22:33.987074 19806 raft_consensus.cc:348] T 339377ab818d44008eba0815673d9630 P 916ba07e6d814ce0b367c877761479a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } }
I20260618 23:22:33.987218 19806 raft_consensus.cc:374] T 339377ab818d44008eba0815673d9630 P 916ba07e6d814ce0b367c877761479a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:22:33.987263 19806 raft_consensus.cc:729] T 339377ab818d44008eba0815673d9630 P 916ba07e6d814ce0b367c877761479a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 916ba07e6d814ce0b367c877761479a8, State: Initialized, Role: FOLLOWER
I20260618 23:22:33.987368 19806 consensus_queue.cc:260] T 339377ab818d44008eba0815673d9630 P 916ba07e6d814ce0b367c877761479a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } }
I20260618 23:22:33.987860 19806 ts_tablet_manager.cc:1428] T 339377ab818d44008eba0815673d9630 P 916ba07e6d814ce0b367c877761479a8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:22:33.987906 19784 heartbeater.cc:503] Master 127.3.217.190:37653 was elected leader, sending a full tablet report...
W20260618 23:22:34.029248 19651 tablet.cc:2369] T 339377ab818d44008eba0815673d9630 P a09ef6e3f59e4f68847129aed9e2e9a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 23:22:34.067170 19807 raft_consensus.cc:482] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:22:34.067291 19807 raft_consensus.cc:504] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } }
I20260618 23:22:34.067682 19807 leader_election.cc:288] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a09ef6e3f59e4f68847129aed9e2e9a9 (127.3.217.130:36205), 916ba07e6d814ce0b367c877761479a8 (127.3.217.131:41939)
I20260618 23:22:34.072219 19798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:34.067976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:46425 (local address 127.3.217.131:41939)
0618 23:22:34.068035 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:34.068037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:34.068158 (+ 121us) server_negotiation.cc:407] Connection header received
0618 23:22:34.068223 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:34.068224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:34.068344 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:34.068422 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:34.068579 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:34.069401 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:34.070918 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:34.071772 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:34.071855 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:34.071865 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:34.072102 (+ 237us) server_negotiation.cc:299] Negotiation successful
0618 23:22:34.072147 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260618 23:22:34.072264 19800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:34.067912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:51889 (local address 127.3.217.130:36205)
0618 23:22:34.067964 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:34.067967 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:34.067978 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:22:34.068078 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:34.068080 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:34.068100 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:34.068171 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:34.068375 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:34.069235 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:34.070918 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:34.071755 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:34.071856 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:34.071865 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:34.072102 (+ 237us) server_negotiation.cc:299] Negotiation successful
0618 23:22:34.072147 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260618 23:22:34.072260 19518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:34.067868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:36205 (local address 127.3.217.129:51889)
0618 23:22:34.067923 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:34.067936 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:34.067981 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:34.068177 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:34.068178 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:34.068180 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:34.068263 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:34.068265 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:34.069339 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:34.069340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:34.070692 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:34.070694 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:34.071880 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:34.071881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:34.071999 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:34.072006 (+ 7us) client_negotiation.cc:769] Sending connection context
0618 23:22:34.072071 (+ 65us) client_negotiation.cc:240] Negotiation successful
0618 23:22:34.072129 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":27}
I20260618 23:22:34.072369 19810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:34.067877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:41939 (local address 127.3.217.129:46425)
0618 23:22:34.068050 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:34.068060 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:34.068152 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:34.068429 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:34.068429 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:34.068431 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:34.068481 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:34.068482 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:34.069486 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:34.069487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:34.070748 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:34.070750 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:34.071880 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:34.071881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:34.071999 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:34.072006 (+ 7us) client_negotiation.cc:769] Sending connection context
0618 23:22:34.072071 (+ 65us) client_negotiation.cc:240] Negotiation successful
0618 23:22:34.072129 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":11,"thread_start_us":121,"threads_started":1}
I20260618 23:22:34.072698 19604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "339377ab818d44008eba0815673d9630" candidate_uuid: "c2f459636e544ed48ec579a26d25ac36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" is_pre_election: true
I20260618 23:22:34.072724 19738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "339377ab818d44008eba0815673d9630" candidate_uuid: "c2f459636e544ed48ec579a26d25ac36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "916ba07e6d814ce0b367c877761479a8" is_pre_election: true
I20260618 23:22:34.072903 19738 raft_consensus.cc:2454] T 339377ab818d44008eba0815673d9630 P 916ba07e6d814ce0b367c877761479a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2f459636e544ed48ec579a26d25ac36 in term 0.
I20260618 23:22:34.072898 19604 raft_consensus.cc:2454] T 339377ab818d44008eba0815673d9630 P a09ef6e3f59e4f68847129aed9e2e9a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2f459636e544ed48ec579a26d25ac36 in term 0.
I20260618 23:22:34.073145 19406 leader_election.cc:302] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 916ba07e6d814ce0b367c877761479a8, c2f459636e544ed48ec579a26d25ac36; no voters:
I20260618 23:22:34.073323 19807 raft_consensus.cc:2781] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:22:34.073378 19807 raft_consensus.cc:482] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:22:34.073401 19807 raft_consensus.cc:3037] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:22:34.074404 19807 raft_consensus.cc:504] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } }
I20260618 23:22:34.074539 19807 leader_election.cc:288] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 1 election: Requested vote from peers a09ef6e3f59e4f68847129aed9e2e9a9 (127.3.217.130:36205), 916ba07e6d814ce0b367c877761479a8 (127.3.217.131:41939)
I20260618 23:22:34.074743 19738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "339377ab818d44008eba0815673d9630" candidate_uuid: "c2f459636e544ed48ec579a26d25ac36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "916ba07e6d814ce0b367c877761479a8"
I20260618 23:22:34.074800 19738 raft_consensus.cc:3037] T 339377ab818d44008eba0815673d9630 P 916ba07e6d814ce0b367c877761479a8 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:22:34.075405 19738 raft_consensus.cc:2454] T 339377ab818d44008eba0815673d9630 P 916ba07e6d814ce0b367c877761479a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2f459636e544ed48ec579a26d25ac36 in term 1.
I20260618 23:22:34.075520 19604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "339377ab818d44008eba0815673d9630" candidate_uuid: "c2f459636e544ed48ec579a26d25ac36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9"
I20260618 23:22:34.075575 19406 leader_election.cc:302] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 916ba07e6d814ce0b367c877761479a8, c2f459636e544ed48ec579a26d25ac36; no voters:
I20260618 23:22:34.075598 19604 raft_consensus.cc:3037] T 339377ab818d44008eba0815673d9630 P a09ef6e3f59e4f68847129aed9e2e9a9 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:22:34.075680 19807 raft_consensus.cc:2781] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:22:34.075866 19807 raft_consensus.cc:686] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [term 1 LEADER]: Becoming Leader. State: Replica: c2f459636e544ed48ec579a26d25ac36, State: Running, Role: LEADER
I20260618 23:22:34.075963 19807 consensus_queue.cc:237] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } }
I20260618 23:22:34.076413 19604 raft_consensus.cc:2454] T 339377ab818d44008eba0815673d9630 P a09ef6e3f59e4f68847129aed9e2e9a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2f459636e544ed48ec579a26d25ac36 in term 1.
I20260618 23:22:34.076771 19325 catalog_manager.cc:5495] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2f459636e544ed48ec579a26d25ac36 (127.3.217.129). New cstate: current_term: 1 leader_uuid: "c2f459636e544ed48ec579a26d25ac36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } health_report { overall_health: UNKNOWN } } }
I20260618 23:22:34.093062 19799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:34.090777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59250 (local address 127.3.217.129:45297)
0618 23:22:34.090845 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:34.090847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:34.090853 (+ 6us) server_negotiation.cc:407] Connection header received
0618 23:22:34.090882 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:34.090883 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:34.090898 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:34.090976 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:22:34.091087 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:34.091550 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:34.092315 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:34.092499 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:34.092582 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:34.092746 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:22:34.092843 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:22:34.092931 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:34.092955 (+ 24us) server_negotiation.cc:299] Negotiation successful
0618 23:22:34.092976 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260618 23:22:34.094652 19738 raft_consensus.cc:1261] T 339377ab818d44008eba0815673d9630 P 916ba07e6d814ce0b367c877761479a8 [term 1 FOLLOWER]: Refusing update from remote peer c2f459636e544ed48ec579a26d25ac36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:22:34.094702 19604 raft_consensus.cc:1261] T 339377ab818d44008eba0815673d9630 P a09ef6e3f59e4f68847129aed9e2e9a9 [term 1 FOLLOWER]: Refusing update from remote peer c2f459636e544ed48ec579a26d25ac36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:22:34.095028 19811 consensus_queue.cc:1035] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:22:34.095182 19807 consensus_queue.cc:1035] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:22:34.099892 19323 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:22:34.099996 19323 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:22:34.100759 19323 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737: Sending DeleteTablet for 3 replicas of tablet 339377ab818d44008eba0815673d9630
I20260618 23:22:34.101094 19718 tablet_service.cc:1514] Processing DeleteTablet for tablet 339377ab818d44008eba0815673d9630 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:22:34 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:58626
I20260618 23:22:34.101117 19450 tablet_service.cc:1514] Processing DeleteTablet for tablet 339377ab818d44008eba0815673d9630 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:22:34 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:59248
I20260618 23:22:34.101125 19584 tablet_service.cc:1514] Processing DeleteTablet for tablet 339377ab818d44008eba0815673d9630 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:22:34 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:58886
I20260618 23:22:34.101346 19826 tablet_replica.cc:330] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36: stopping tablet replica
I20260618 23:22:34.101444 19826 raft_consensus.cc:2229] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:22:34.101459 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 19387
I20260618 23:22:34.101560 19826 raft_consensus.cc:2258] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:22:34.102128 19825 tablet_replica.cc:330] T 339377ab818d44008eba0815673d9630 P a09ef6e3f59e4f68847129aed9e2e9a9: stopping tablet replica
I20260618 23:22:34.102206 19825 raft_consensus.cc:2229] T 339377ab818d44008eba0815673d9630 P a09ef6e3f59e4f68847129aed9e2e9a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:22:34.102283 19825 raft_consensus.cc:2258] T 339377ab818d44008eba0815673d9630 P a09ef6e3f59e4f68847129aed9e2e9a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:22:34.102753 19825 ts_tablet_manager.cc:1905] T 339377ab818d44008eba0815673d9630 P a09ef6e3f59e4f68847129aed9e2e9a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:22:34.105211 19825 ts_tablet_manager.cc:1918] T 339377ab818d44008eba0815673d9630 P a09ef6e3f59e4f68847129aed9e2e9a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:22:34.105291 19825 log.cc:1196] T 339377ab818d44008eba0815673d9630 P a09ef6e3f59e4f68847129aed9e2e9a9: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/339377ab818d44008eba0815673d9630
I20260618 23:22:34.105574 19825 ts_tablet_manager.cc:1939] T 339377ab818d44008eba0815673d9630 P a09ef6e3f59e4f68847129aed9e2e9a9: Deleting consensus metadata
I20260618 23:22:34.105986 19310 catalog_manager.cc:4841] TS a09ef6e3f59e4f68847129aed9e2e9a9 (127.3.217.130:36205): tablet 339377ab818d44008eba0815673d9630 (table test-table [id=95110911550c4020994c72807183e5ee]) successfully deleted
I20260618 23:22:34.106868 19824 tablet_replica.cc:330] T 339377ab818d44008eba0815673d9630 P 916ba07e6d814ce0b367c877761479a8: stopping tablet replica
W20260618 23:22:34.107267 19311 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.217.129:45297 (error 108)
I20260618 23:22:34.107348 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 19521
I20260618 23:22:34.106983 19824 raft_consensus.cc:2229] T 339377ab818d44008eba0815673d9630 P 916ba07e6d814ce0b367c877761479a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:22:34.108369 19824 raft_consensus.cc:2258] T 339377ab818d44008eba0815673d9630 P 916ba07e6d814ce0b367c877761479a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:22:34.108788 19824 ts_tablet_manager.cc:1905] T 339377ab818d44008eba0815673d9630 P 916ba07e6d814ce0b367c877761479a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:22:34.110755 19824 ts_tablet_manager.cc:1918] T 339377ab818d44008eba0815673d9630 P 916ba07e6d814ce0b367c877761479a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:22:34.110833 19824 log.cc:1196] T 339377ab818d44008eba0815673d9630 P 916ba07e6d814ce0b367c877761479a8: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/339377ab818d44008eba0815673d9630
I20260618 23:22:34.111109 19824 ts_tablet_manager.cc:1939] T 339377ab818d44008eba0815673d9630 P 916ba07e6d814ce0b367c877761479a8: Deleting consensus metadata
I20260618 23:22:34.111234 19797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:34.111099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:45297 (local address 127.0.0.1:59260)
0618 23:22:34.111155 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:34.111193 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.129:45297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260618 23:22:34.111378 19311 catalog_manager.cc:4584] TS c2f459636e544ed48ec579a26d25ac36 (127.3.217.129:45297): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 339377ab818d44008eba0815673d9630: Network error: Client connection negotiation failed: client connection to 127.3.217.129:45297: connect: Connection refused (error 111)
I20260618 23:22:34.111507 19312 catalog_manager.cc:4841] TS 916ba07e6d814ce0b367c877761479a8 (127.3.217.131:41939): tablet 339377ab818d44008eba0815673d9630 (table test-table [id=95110911550c4020994c72807183e5ee]) successfully deleted
I20260618 23:22:34.113551 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 19655
I20260618 23:22:34.118134 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 19293
I20260618 23:22:54.123893 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:37653
--webserver_interface=127.3.217.190
--webserver_port=45635
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:38745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:37653
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:22:54.210125 19828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:54.210372 19828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:54.210412 19828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:54.211573 19828 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260618 23:22:54.211643 19828 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260618 23:22:54.211665 19828 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260618 23:22:54.211684 19828 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:22:54.211714 19828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:54.211735 19828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:54.211755 19828 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:22:54.211784 19828 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:22:54.213240 19828 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:38745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:37653
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:37653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=45635
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:54.213533 19828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:54.213761 19828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:54.223449 19834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:54.223413 19837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:54.223485 19828 server_base.cc:1034] running on GCE node
W20260618 23:22:54.223418 19835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:54.223979 19828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:54.224306 19828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:54.225623 19828 hybrid_clock.cc:648] HybridClock initialized: now 1781824974225545 us; error 44 us; skew 500 ppm
Jun 18 23:22:54 dist-test-slave-r9ct krb5kdc[19280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824974, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:54.228749 19828 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:22:54.229323 19828 webserver.cc:460] Webserver started at http://127.3.217.190:45635/ using document root <none> and password file <none>
I20260618 23:22:54.229576 19828 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:54.229676 19828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:54.231268 19828 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260618 23:22:54.232424 19844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:54.232767 19828 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:54.232901 19828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "6411182249714edf99af8f7055968737"
format_stamp: "Formatted at 2026-06-18 23:22:33 on dist-test-slave-r9ct"
server_key: "fdafc0ca7e65472b614763de85e60ed7"
server_key_iv: "86e63c2691c3b01b6144a6b3b7c63c4e"
server_key_version: "encryptionkey@0"
I20260618 23:22:54.233364 19828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:54.259567 19828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:54.262084 19828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:54.262257 19828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:54.266669 19828 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:37653
I20260618 23:22:54.266789 19896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:37653 every 8 connection(s)
I20260618 23:22:54.267135 19828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:22:54.269012 19897 sys_catalog.cc:263] Verifying existing consensus state
I20260618 23:22:54.269711 19897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737: Bootstrap starting.
I20260618 23:22:54.270756 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 19828
I20260618 23:22:54.271075 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:45297
--local_ip_for_outbound_sockets=127.3.217.129
--tserver_master_addrs=127.3.217.190:37653
--webserver_port=37049
--webserver_interface=127.3.217.129
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:38745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260618 23:22:54.277993 19897 log.cc:824] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:54.280170 19897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260618 23:22:54.280501 19897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737: Bootstrap complete.
I20260618 23:22:54.282848 19897 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6411182249714edf99af8f7055968737" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37653 } }
I20260618 23:22:54.283108 19897 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6411182249714edf99af8f7055968737, State: Initialized, Role: FOLLOWER
I20260618 23:22:54.283298 19897 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6411182249714edf99af8f7055968737" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37653 } }
I20260618 23:22:54.283381 19897 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:22:54.283437 19897 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:22:54.283485 19897 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 1 FOLLOWER]: Advancing to term 2
I20260618 23:22:54.284478 19897 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6411182249714edf99af8f7055968737" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37653 } }
I20260618 23:22:54.284602 19897 leader_election.cc:302] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6411182249714edf99af8f7055968737; no voters:
I20260618 23:22:54.284822 19897 leader_election.cc:288] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260618 23:22:54.284859 19901 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 2 FOLLOWER]: Leader election won for term 2
I20260618 23:22:54.284976 19901 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 2 LEADER]: Becoming Leader. State: Replica: 6411182249714edf99af8f7055968737, State: Running, Role: LEADER
I20260618 23:22:54.285068 19901 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6411182249714edf99af8f7055968737" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37653 } }
I20260618 23:22:54.285189 19897 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:22:54.285303 19901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6411182249714edf99af8f7055968737. Latest consensus state: current_term: 2 leader_uuid: "6411182249714edf99af8f7055968737" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6411182249714edf99af8f7055968737" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37653 } } }
I20260618 23:22:54.285370 19901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [sys.catalog]: This master's current role is: LEADER
I20260618 23:22:54.285529 19905 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:22:54.286183 19902 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6411182249714edf99af8f7055968737" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6411182249714edf99af8f7055968737" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37653 } } }
I20260618 23:22:54.286327 19902 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [sys.catalog]: This master's current role is: LEADER
I20260618 23:22:54.286396 19905 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:22:54.286511 19905 catalog_manager.cc:1259] Loaded cluster ID: ba811f21f807407a86c1447f5ab34667
I20260618 23:22:54.286550 19905 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:22:54.287861 19905 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:22:54.288034 19905 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737: Loaded TSK: 0
I20260618 23:22:54.305074 19905 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737: Generated new TSK 1
I20260618 23:22:54.305183 19905 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260618 23:22:54.355764 19899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:54.356014 19899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:54.356055 19899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:54.357332 19899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:54.357401 19899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:54.357446 19899 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:22:54.359071 19899 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:38745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:45297
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=37049
--tserver_master_addrs=127.3.217.190:37653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19899
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:54.359331 19899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:54.359562 19899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:54.365633 19924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:54.365796 19925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:54.365957 19927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:54.365944 19899 server_base.cc:1034] running on GCE node
I20260618 23:22:54.366340 19899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:54.366613 19899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:54.367894 19899 hybrid_clock.cc:648] HybridClock initialized: now 1781824974367879 us; error 46 us; skew 500 ppm
Jun 18 23:22:54 dist-test-slave-r9ct krb5kdc[19280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824974, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:54.371502 19899 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:22:54.372257 19899 webserver.cc:460] Webserver started at http://127.3.217.129:37049/ using document root <none> and password file <none>
I20260618 23:22:54.372516 19899 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:54.372614 19899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:54.374338 19899 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:54.375185 19934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:54.375468 19899 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260618 23:22:54.375587 19899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "c2f459636e544ed48ec579a26d25ac36"
format_stamp: "Formatted at 2026-06-18 23:22:33 on dist-test-slave-r9ct"
server_key: "cf8ba9ae4757f82484a60e0f8f93e3b3"
server_key_iv: "ad87a3a812c8ed4964400a8df7a843d3"
server_key_version: "encryptionkey@0"
I20260618 23:22:54.375998 19899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:54.393942 19899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:54.396639 19899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:54.396838 19899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:54.397094 19899 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:22:54.397572 19941 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260618 23:22:54.399479 19899 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260618 23:22:54.399636 19899 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260618 23:22:54.399713 19899 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260618 23:22:54.400599 19899 ts_tablet_manager.cc:610] Registered 1 tablets
I20260618 23:22:54.400669 19899 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260618 23:22:54.400784 19941 tablet_bootstrap.cc:492] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36: Bootstrap starting.
I20260618 23:22:54.408385 19899 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:45297
I20260618 23:22:54.408429 20048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:45297 every 8 connection(s)
I20260618 23:22:54.408793 19899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:22:54.411757 19941 log.cc:824] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:54.414194 19941 tablet_bootstrap.cc:492] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260618 23:22:54.414535 19941 tablet_bootstrap.cc:492] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36: Bootstrap complete.
I20260618 23:22:54.415832 19941 ts_tablet_manager.cc:1397] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.007s
I20260618 23:22:54.416695 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 19899
I20260618 23:22:54.416986 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:36205
--local_ip_for_outbound_sockets=127.3.217.130
--tserver_master_addrs=127.3.217.190:37653
--webserver_port=43095
--webserver_interface=127.3.217.130
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:38745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260618 23:22:54.417428 19941 raft_consensus.cc:348] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } }
I20260618 23:22:54.417801 19941 raft_consensus.cc:729] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2f459636e544ed48ec579a26d25ac36, State: Initialized, Role: FOLLOWER
Jun 18 23:22:54 dist-test-slave-r9ct krb5kdc[19280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824974, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:54.417932 19941 consensus_queue.cc:260] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } }
I20260618 23:22:54.418198 19941 ts_tablet_manager.cc:1428] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260618 23:22:54.422637 20052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:54.409600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:41723 (local address 127.3.217.190:37653)
0618 23:22:54.410876 (+ 1276us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:54.410885 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:54.410916 (+ 31us) server_negotiation.cc:407] Connection header received
0618 23:22:54.411012 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:54.411016 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:54.411060 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:54.411204 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:54.411994 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.413338 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.414934 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.415631 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.415735 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:54.418497 (+ 2762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:54.418502 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:54.418503 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:54.418517 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:54.420655 (+ 2138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:54.421137 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:54.421140 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:54.421141 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:54.421244 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:54.421573 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:54.421574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:54.421574 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:54.421855 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:54.421936 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:54.422309 (+ 373us) server_negotiation.cc:299] Negotiation successful
0618 23:22:54.422439 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1231,"thread_start_us":79,"threads_started":1}
I20260618 23:22:54.422694 20051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:54.409518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.129:41723)
0618 23:22:54.409713 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:54.409754 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:54.410194 (+ 440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:54.411235 (+ 1041us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:54.411239 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:54.411634 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:54.411894 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:54.411900 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.413496 (+ 1596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.413497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:54.414827 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:54.414830 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.415754 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.415755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:54.415905 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:54.416561 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:54.416571 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:54.418364 (+ 1793us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:54.420753 (+ 2389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:54.420759 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:54.420762 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:54.421041 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:54.421325 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:54.421326 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:54.421327 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:54.421482 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:54.421940 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:54.421947 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:54.422114 (+ 167us) client_negotiation.cc:769] Sending connection context
0618 23:22:54.422242 (+ 128us) client_negotiation.cc:240] Negotiation successful
0618 23:22:54.422433 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":116,"threads_started":1}
I20260618 23:22:54.423586 20049 heartbeater.cc:347] Connected to a master server at 127.3.217.190:37653
I20260618 23:22:54.423691 20049 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:54.423897 20049 heartbeater.cc:511] Master 127.3.217.190:37653 requested a full tablet report, sending...
I20260618 23:22:54.424732 19860 ts_manager.cc:194] Registered new tserver with Master: c2f459636e544ed48ec579a26d25ac36 (127.3.217.129:45297)
I20260618 23:22:54.426075 19860 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:41723
I20260618 23:22:54.427186 20049 heartbeater.cc:503] Master 127.3.217.190:37653 was elected leader, sending a full tablet report...
Jun 18 23:22:54 dist-test-slave-r9ct krb5kdc[19280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824974, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for kudu/127.3.217.129@KRBTEST.COM
I20260618 23:22:54.435693 20057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:54.425740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39624 (local address 127.3.217.129:45297)
0618 23:22:54.426157 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:54.426227 (+ 70us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:54.426239 (+ 12us) server_negotiation.cc:407] Connection header received
0618 23:22:54.426271 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:54.426274 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:54.426288 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:54.426462 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:54.427043 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.428253 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.429479 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.429930 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.430007 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:54.432393 (+ 2386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:54.432401 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:54.432401 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:54.432408 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:54.434239 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:54.434730 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:54.434733 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:54.434734 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:54.434810 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:54.435028 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:54.435029 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:54.435029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:54.435197 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:54.435277 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:54.435497 (+ 220us) server_negotiation.cc:299] Negotiation successful
0618 23:22:54.435597 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":80,"threads_started":1}
I20260618 23:22:54.435978 20056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:54.425436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:45297 (local address 127.0.0.1:39624)
0618 23:22:54.425910 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:54.425952 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:54.426018 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:54.426526 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:54.426529 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:54.426900 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:54.426955 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:54.426958 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.428357 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.428358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:54.429375 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:54.429379 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.430015 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.430016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:54.430102 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:54.430612 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:54.430617 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:54.432302 (+ 1685us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:54.434335 (+ 2033us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:54.434341 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:54.434343 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:54.434611 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:54.434878 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:54.434878 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:54.434879 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:54.434948 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:54.435277 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:54.435283 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:54.435340 (+ 57us) client_negotiation.cc:769] Sending connection context
0618 23:22:54.435437 (+ 97us) client_negotiation.cc:240] Negotiation successful
0618 23:22:54.435562 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":116,"threads_started":1}
I20260618 23:22:54.436625 19983 tablet_service.cc:1514] Processing DeleteTablet for tablet 339377ab818d44008eba0815673d9630 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:22:34 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:39624
I20260618 23:22:54.437434 20058 tablet_replica.cc:330] stopping tablet replica
I20260618 23:22:54.437600 20058 raft_consensus.cc:2229] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:22:54.437685 20058 raft_consensus.cc:2258] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:22:54.438247 20058 ts_tablet_manager.cc:1905] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:22:54.441220 20058 ts_tablet_manager.cc:1918] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:22:54.441371 20058 log.cc:1196] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/wal/wals/339377ab818d44008eba0815673d9630
I20260618 23:22:54.441630 20058 ts_tablet_manager.cc:1939] T 339377ab818d44008eba0815673d9630 P c2f459636e544ed48ec579a26d25ac36: Deleting consensus metadata
I20260618 23:22:54.442297 19847 catalog_manager.cc:4841] TS c2f459636e544ed48ec579a26d25ac36 (127.3.217.129:45297): tablet 339377ab818d44008eba0815673d9630 (table test-table [id=95110911550c4020994c72807183e5ee]) successfully deleted
W20260618 23:22:54.507658 20055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:54.507881 20055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:54.507921 20055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:54.509123 20055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:54.509196 20055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:54.509241 20055 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:22:54.510803 20055 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:38745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:36205
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=43095
--tserver_master_addrs=127.3.217.190:37653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20055
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:54.511062 20055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:54.511297 20055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:54.516558 20063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:54.516607 20055 server_base.cc:1034] running on GCE node
W20260618 23:22:54.516558 20066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:54.516589 20064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:54.516965 20055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:54.517231 20055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:54.518383 20055 hybrid_clock.cc:648] HybridClock initialized: now 1781824974518367 us; error 30 us; skew 500 ppm
Jun 18 23:22:54 dist-test-slave-r9ct krb5kdc[19280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824974, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:54.520993 20055 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:22:54.521420 20055 webserver.cc:460] Webserver started at http://127.3.217.130:43095/ using document root <none> and password file <none>
I20260618 23:22:54.521673 20055 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:54.521767 20055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:54.523108 20055 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:22:54.523698 20073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:54.523885 20055 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260618 23:22:54.523980 20055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "a09ef6e3f59e4f68847129aed9e2e9a9"
format_stamp: "Formatted at 2026-06-18 23:22:33 on dist-test-slave-r9ct"
server_key: "8935bc5649487b24ee87be949fd2453c"
server_key_iv: "7bb37d3b2e3ec4721233a0b9f2ffd2d7"
server_key_version: "encryptionkey@0"
I20260618 23:22:54.524308 20055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:54.536223 20055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:54.538446 20055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:54.538630 20055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:54.538897 20055 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:22:54.539201 20055 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:22:54.539264 20055 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:54.539306 20055 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:22:54.539333 20055 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:54.545214 20055 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:36205
I20260618 23:22:54.545361 20186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:36205 every 8 connection(s)
I20260618 23:22:54.545645 20055 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:22:54.553056 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 20055
I20260618 23:22:54.553364 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:41939
--local_ip_for_outbound_sockets=127.3.217.131
--tserver_master_addrs=127.3.217.190:37653
--webserver_port=41533
--webserver_interface=127.3.217.131
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:38745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 18 23:22:54 dist-test-slave-r9ct krb5kdc[19280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824974, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:54.557672 20052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:54.546761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:33189 (local address 127.3.217.190:37653)
0618 23:22:54.546835 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:54.546837 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:54.547085 (+ 248us) server_negotiation.cc:407] Connection header received
0618 23:22:54.547793 (+ 708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:54.547795 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:54.547810 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:54.547882 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:54.549125 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.549678 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.550983 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.551214 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.551305 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:54.553957 (+ 2652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:54.553959 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:54.553959 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:54.553968 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:54.555937 (+ 1969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:54.556459 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:54.556460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:54.556460 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:54.556518 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:54.556906 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:54.556907 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:54.556908 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:54.557054 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:54.557117 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:54.557506 (+ 389us) server_negotiation.cc:299] Negotiation successful
0618 23:22:54.557604 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260618 23:22:54.557989 20189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:54.546630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.130:33189)
0618 23:22:54.546926 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:54.546975 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:54.547651 (+ 676us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:54.547946 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:54.547949 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:54.548745 (+ 796us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:54.549000 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:54.549005 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.549830 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.549831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:54.550880 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:54.550883 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.551404 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.551406 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:54.551570 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:54.552224 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:54.552232 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:54.553841 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:54.556030 (+ 2189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:54.556037 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:54.556039 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:54.556350 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:54.556601 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:54.556602 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:54.556602 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:54.556755 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:54.557137 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:54.557144 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:54.557322 (+ 178us) client_negotiation.cc:769] Sending connection context
0618 23:22:54.557449 (+ 127us) client_negotiation.cc:240] Negotiation successful
0618 23:22:54.557649 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":146,"threads_started":1}
I20260618 23:22:54.558534 20187 heartbeater.cc:347] Connected to a master server at 127.3.217.190:37653
I20260618 23:22:54.558630 20187 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:54.558863 20187 heartbeater.cc:511] Master 127.3.217.190:37653 requested a full tablet report, sending...
I20260618 23:22:54.559350 19860 ts_manager.cc:194] Registered new tserver with Master: a09ef6e3f59e4f68847129aed9e2e9a9 (127.3.217.130:36205)
I20260618 23:22:54.559829 19860 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:33189
W20260618 23:22:54.636893 20190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:22:54.637133 20190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:22:54.637171 20190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:22:54.638350 20190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:22:54.638427 20190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:22:54.638475 20190 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:22:54.639984 20190 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:38745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:41939
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=41533
--tserver_master_addrs=127.3.217.190:37653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:22:54.640254 20190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:22:54.640507 20190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:22:54.645802 20195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:54.645820 20198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:22:54.645817 20196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:22:54.646181 20190 server_base.cc:1034] running on GCE node
I20260618 23:22:54.646438 20190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:22:54.646901 20190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:22:54.648137 20190 hybrid_clock.cc:648] HybridClock initialized: now 1781824974648118 us; error 43 us; skew 500 ppm
Jun 18 23:22:54 dist-test-slave-r9ct krb5kdc[19280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824974, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:22:54.650939 20190 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:22:54.651424 20190 webserver.cc:460] Webserver started at http://127.3.217.131:41533/ using document root <none> and password file <none>
I20260618 23:22:54.651741 20190 fs_manager.cc:359] Metadata directory not provided
I20260618 23:22:54.651837 20190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:22:54.653409 20190 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260618 23:22:54.654141 20205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:54.654482 20190 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:22:54.654618 20190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "916ba07e6d814ce0b367c877761479a8"
format_stamp: "Formatted at 2026-06-18 23:22:33 on dist-test-slave-r9ct"
server_key: "0c9c1ca5e28c3e323a246c0c3a227696"
server_key_iv: "be65de8f255264c1a1db283e5b7d9fdb"
server_key_version: "encryptionkey@0"
I20260618 23:22:54.655058 20190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:22:54.676891 20190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:22:54.679426 20190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:22:54.679605 20190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:22:54.679888 20190 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:22:54.680246 20190 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:22:54.680302 20190 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:54.680348 20190 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:22:54.680374 20190 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:22:54.687067 20190 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:41939
I20260618 23:22:54.687151 20318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:41939 every 8 connection(s)
I20260618 23:22:54.687526 20190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:22:54.689872 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 20190
Jun 18 23:22:54 dist-test-slave-r9ct krb5kdc[19280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824974, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:22:54.698259 20322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:54.690317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49984 (local address 127.3.217.190:37653)
0618 23:22:54.690438 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:54.690440 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:54.690547 (+ 107us) server_negotiation.cc:407] Connection header received
0618 23:22:54.690617 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:54.690618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:54.690631 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:54.690772 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:54.691433 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.692149 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.693135 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.693461 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.693545 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:54.694931 (+ 1386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:54.694932 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:54.694932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:54.694940 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:54.696797 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:54.697214 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:54.697215 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:54.697216 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:54.697276 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:54.697492 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:54.697493 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:54.697493 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:54.697642 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:54.697792 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:54.698033 (+ 241us) server_negotiation.cc:299] Negotiation successful
0618 23:22:54.698120 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":54,"threads_started":1}
I20260618 23:22:54.699347 20052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:54.688344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:35105 (local address 127.3.217.190:37653)
0618 23:22:54.688431 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:54.688433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:54.688539 (+ 106us) server_negotiation.cc:407] Connection header received
0618 23:22:54.689022 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:54.689023 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:54.689033 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:54.689088 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:54.690201 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.690992 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.692419 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.692713 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.692793 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:54.695110 (+ 2317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:54.695111 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:54.695112 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:54.695117 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:54.696992 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:54.697777 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:54.697779 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:54.697780 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:54.697878 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:54.698366 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:54.698367 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:54.698368 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:54.698532 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:54.698619 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:54.699145 (+ 526us) server_negotiation.cc:299] Negotiation successful
0618 23:22:54.699241 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260618 23:22:54.699610 20321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:54.688265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.131:35105)
0618 23:22:54.688410 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:54.688456 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:54.688917 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:54.689138 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:54.689141 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:54.689787 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:22:54.690077 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:54.690083 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.691107 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.691108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:54.692340 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:54.692342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.692831 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.692832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:54.692952 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:54.693485 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:22:54.693495 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:22:54.694990 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:22:54.697092 (+ 2102us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:54.697097 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:54.697099 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:54.697554 (+ 455us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:54.698008 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:22:54.698010 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:22:54.698010 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:22:54.698146 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:22:54.698663 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:22:54.698679 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:22:54.698923 (+ 244us) client_negotiation.cc:769] Sending connection context
0618 23:22:54.699120 (+ 197us) client_negotiation.cc:240] Negotiation successful
0618 23:22:54.699335 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":70,"threads_started":1}
I20260618 23:22:54.700157 20319 heartbeater.cc:347] Connected to a master server at 127.3.217.190:37653
I20260618 23:22:54.700302 20319 heartbeater.cc:464] Registering TS with master...
I20260618 23:22:54.700472 20319 heartbeater.cc:511] Master 127.3.217.190:37653 requested a full tablet report, sending...
I20260618 23:22:54.700945 19860 ts_manager.cc:194] Registered new tserver with Master: 916ba07e6d814ce0b367c877761479a8 (127.3.217.131:41939)
I20260618 23:22:54.701318 19860 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:35105
I20260618 23:22:54.710011 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260618 23:22:54.713106 19787 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.3.217.190:37653)
I20260618 23:22:54.713968 20052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:54.710413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49992 (local address 127.3.217.190:37653)
0618 23:22:54.710473 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:54.710475 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:54.710617 (+ 142us) server_negotiation.cc:407] Connection header received
0618 23:22:54.710660 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:54.710660 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:54.710693 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:54.710822 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:22:54.710938 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.711415 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.712259 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.712441 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.712504 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:54.712683 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:22:54.712725 (+ 42us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0618 23:22:54.713875 (+ 1150us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49992: token expired
Metrics: {"server-negotiator.queue_time_us":36}
W20260618 23:22:54.714031 20052 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49992: token expired
I20260618 23:22:54.720469 20322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:54.713441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50008 (local address 127.3.217.190:37653)
0618 23:22:54.713509 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:54.713510 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:54.713519 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:22:54.713538 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:54.713538 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:54.713549 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:54.713598 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:22:54.714147 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.714592 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.715632 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.716196 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.716276 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:54.717579 (+ 1303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:22:54.717581 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:22:54.717581 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:22:54.717587 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:22:54.719301 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:54.719685 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:54.719686 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:54.719686 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:54.719751 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:22:54.719960 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:22:54.719961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:22:54.719961 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:22:54.720076 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:22:54.720187 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:54.720287 (+ 100us) server_negotiation.cc:299] Negotiation successful
0618 23:22:54.720369 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260618 23:22:54.721673 19860 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50008:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:22:54.723466 19860 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:22:54.727286 19983 tablet_service.cc:1467] Processing CreateTablet for tablet a0d172b400ac4c0fa62ef4ab1abdd5e3 (DEFAULT_TABLE table=test-table [id=9c5ec0df30cf4dc98a800c0de239d5bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:22:54.727641 19983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0d172b400ac4c0fa62ef4ab1abdd5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:54.730129 19941 tablet_bootstrap.cc:492] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36: Bootstrap starting.
I20260618 23:22:54.730613 19941 tablet_bootstrap.cc:654] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36: Neither blocks nor log segments found. Creating new log.
I20260618 23:22:54.731345 19941 tablet_bootstrap.cc:492] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36: No bootstrap required, opened a new log
I20260618 23:22:54.731396 19941 ts_tablet_manager.cc:1397] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260618 23:22:54.731628 20326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:54.726939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:36205 (local address 127.0.0.1:36634)
0618 23:22:54.727453 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:54.727467 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:54.727530 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:54.727833 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:54.727834 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:54.727836 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:54.727877 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:54.727878 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.729126 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.729127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:54.730019 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:54.730063 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.731337 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.731338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:54.731404 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:54.731427 (+ 23us) client_negotiation.cc:769] Sending connection context
0618 23:22:54.731488 (+ 61us) client_negotiation.cc:240] Negotiation successful
0618 23:22:54.731530 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"mutex_wait_us":44,"thread_start_us":212,"threads_started":1}
I20260618 23:22:54.731770 20056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:54.726686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:41939 (local address 127.0.0.1:55448)
0618 23:22:54.726753 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:54.726766 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:54.726812 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:54.727374 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:54.727375 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:54.727377 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:54.727433 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:54.727434 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.729096 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.729097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:54.730289 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:54.730292 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.731358 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.731359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:54.731523 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:54.731529 (+ 6us) client_negotiation.cc:769] Sending connection context
0618 23:22:54.731602 (+ 73us) client_negotiation.cc:240] Negotiation successful
0618 23:22:54.731649 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":31}
I20260618 23:22:54.731752 19941 raft_consensus.cc:348] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } }
I20260618 23:22:54.731824 19941 raft_consensus.cc:374] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:22:54.731861 20325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:54.726928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55448 (local address 127.3.217.131:41939)
0618 23:22:54.727164 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:54.727169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:54.727183 (+ 14us) server_negotiation.cc:407] Connection header received
0618 23:22:54.727216 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:54.727218 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:54.727233 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:54.727690 (+ 457us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:54.727831 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.728964 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.730485 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.731262 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.731358 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:54.731515 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:54.731635 (+ 120us) server_negotiation.cc:299] Negotiation successful
0618 23:22:54.731673 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":138,"threads_started":1}
I20260618 23:22:54.731882 20327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:54.727357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36634 (local address 127.3.217.130:36205)
0618 23:22:54.727590 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:54.727594 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:54.727606 (+ 12us) server_negotiation.cc:407] Connection header received
0618 23:22:54.727644 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:54.727645 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:54.727660 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:54.727735 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:54.727985 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.729068 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.730166 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.731108 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.731207 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:54.731268 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:54.731741 (+ 473us) server_negotiation.cc:299] Negotiation successful
0618 23:22:54.731788 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":118,"threads_started":1}
I20260618 23:22:54.731897 19941 raft_consensus.cc:729] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2f459636e544ed48ec579a26d25ac36, State: Initialized, Role: FOLLOWER
I20260618 23:22:54.731949 19941 consensus_queue.cc:260] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } }
I20260618 23:22:54.732077 19941 ts_tablet_manager.cc:1428] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260618 23:22:54.732976 20121 tablet_service.cc:1467] Processing CreateTablet for tablet a0d172b400ac4c0fa62ef4ab1abdd5e3 (DEFAULT_TABLE table=test-table [id=9c5ec0df30cf4dc98a800c0de239d5bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:22:54.733023 20253 tablet_service.cc:1467] Processing CreateTablet for tablet a0d172b400ac4c0fa62ef4ab1abdd5e3 (DEFAULT_TABLE table=test-table [id=9c5ec0df30cf4dc98a800c0de239d5bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:22:54.733327 20121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0d172b400ac4c0fa62ef4ab1abdd5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:54.733355 20253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0d172b400ac4c0fa62ef4ab1abdd5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:22:54.737962 20330 tablet_bootstrap.cc:492] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9: Bootstrap starting.
I20260618 23:22:54.739176 20330 tablet_bootstrap.cc:654] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9: Neither blocks nor log segments found. Creating new log.
I20260618 23:22:54.739218 20329 tablet_bootstrap.cc:492] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P 916ba07e6d814ce0b367c877761479a8: Bootstrap starting.
I20260618 23:22:54.739970 20330 log.cc:824] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:54.740429 20329 tablet_bootstrap.cc:654] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P 916ba07e6d814ce0b367c877761479a8: Neither blocks nor log segments found. Creating new log.
I20260618 23:22:54.740993 20329 log.cc:824] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P 916ba07e6d814ce0b367c877761479a8: Log is configured to *not* fsync() on all Append() calls
I20260618 23:22:54.741245 20330 tablet_bootstrap.cc:492] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9: No bootstrap required, opened a new log
I20260618 23:22:54.741321 20330 ts_tablet_manager.cc:1397] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260618 23:22:54.741761 20329 tablet_bootstrap.cc:492] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P 916ba07e6d814ce0b367c877761479a8: No bootstrap required, opened a new log
I20260618 23:22:54.741830 20329 ts_tablet_manager.cc:1397] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P 916ba07e6d814ce0b367c877761479a8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260618 23:22:54.743422 20330 raft_consensus.cc:348] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } }
I20260618 23:22:54.743613 20330 raft_consensus.cc:374] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:22:54.743649 20330 raft_consensus.cc:729] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a09ef6e3f59e4f68847129aed9e2e9a9, State: Initialized, Role: FOLLOWER
I20260618 23:22:54.743764 20330 consensus_queue.cc:260] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } }
I20260618 23:22:54.743786 20329 raft_consensus.cc:348] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P 916ba07e6d814ce0b367c877761479a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } }
I20260618 23:22:54.743947 20329 raft_consensus.cc:374] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P 916ba07e6d814ce0b367c877761479a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:22:54.744052 20330 ts_tablet_manager.cc:1428] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260618 23:22:54.744093 20329 raft_consensus.cc:729] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P 916ba07e6d814ce0b367c877761479a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 916ba07e6d814ce0b367c877761479a8, State: Initialized, Role: FOLLOWER
I20260618 23:22:54.744172 20187 heartbeater.cc:503] Master 127.3.217.190:37653 was elected leader, sending a full tablet report...
I20260618 23:22:54.744231 20329 consensus_queue.cc:260] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P 916ba07e6d814ce0b367c877761479a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } }
I20260618 23:22:54.744493 20329 ts_tablet_manager.cc:1428] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P 916ba07e6d814ce0b367c877761479a8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260618 23:22:54.744619 20319 heartbeater.cc:503] Master 127.3.217.190:37653 was elected leader, sending a full tablet report...
W20260618 23:22:54.796442 20188 tablet.cc:2369] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 23:22:54.826309 20333 raft_consensus.cc:482] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:22:54.826597 20333 raft_consensus.cc:504] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } }
I20260618 23:22:54.827172 20333 leader_election.cc:288] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 916ba07e6d814ce0b367c877761479a8 (127.3.217.131:41939), c2f459636e544ed48ec579a26d25ac36 (127.3.217.129:45297)
I20260618 23:22:54.831012 20325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:54.827478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:60773 (local address 127.3.217.131:41939)
0618 23:22:54.827553 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:54.827555 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:54.827829 (+ 274us) server_negotiation.cc:407] Connection header received
0618 23:22:54.827926 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:54.827927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:54.827940 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:54.828026 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:54.828391 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.828967 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.830032 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.830505 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.830569 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:54.830577 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:54.830872 (+ 295us) server_negotiation.cc:299] Negotiation successful
0618 23:22:54.830921 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260618 23:22:54.831001 20189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:54.827401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:41939 (local address 127.3.217.130:60773)
0618 23:22:54.827565 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:54.827691 (+ 126us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:54.827827 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:54.828104 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:54.828106 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:54.828109 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:54.828214 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:54.828217 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.829085 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.829085 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:54.829901 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:54.829903 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.830698 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.830699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:54.830786 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:54.830791 (+ 5us) client_negotiation.cc:769] Sending connection context
0618 23:22:54.830846 (+ 55us) client_negotiation.cc:240] Negotiation successful
0618 23:22:54.830891 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":63}
I20260618 23:22:54.831159 20057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:54.827506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:36099 (local address 127.3.217.129:45297)
0618 23:22:54.827672 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:54.827675 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:54.827697 (+ 22us) server_negotiation.cc:407] Connection header received
0618 23:22:54.827804 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:54.827806 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:54.827840 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:54.828052 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:22:54.828151 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.828822 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.830118 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.830532 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.830761 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:54.830858 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:54.831017 (+ 159us) server_negotiation.cc:299] Negotiation successful
0618 23:22:54.831070 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260618 23:22:54.831223 20335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:54.827416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:45297 (local address 127.3.217.130:36099)
0618 23:22:54.827630 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:54.827640 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:22:54.827698 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:22:54.827945 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:22:54.827947 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:22:54.827949 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:22:54.828076 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:54.828079 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.828957 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.828958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:54.830009 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:22:54.830012 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.830819 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.830839 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:22:54.830916 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:54.830920 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:22:54.830990 (+ 70us) client_negotiation.cc:240] Negotiation successful
0618 23:22:54.831030 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":108,"thread_start_us":120,"threads_started":1}
I20260618 23:22:54.831560 20273 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0d172b400ac4c0fa62ef4ab1abdd5e3" candidate_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "916ba07e6d814ce0b367c877761479a8" is_pre_election: true
I20260618 23:22:54.831565 20003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0d172b400ac4c0fa62ef4ab1abdd5e3" candidate_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2f459636e544ed48ec579a26d25ac36" is_pre_election: true
I20260618 23:22:54.831741 20003 raft_consensus.cc:2454] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09ef6e3f59e4f68847129aed9e2e9a9 in term 0.
I20260618 23:22:54.831700 20273 raft_consensus.cc:2454] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P 916ba07e6d814ce0b367c877761479a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a09ef6e3f59e4f68847129aed9e2e9a9 in term 0.
I20260618 23:22:54.832103 20076 leader_election.cc:302] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a09ef6e3f59e4f68847129aed9e2e9a9, c2f459636e544ed48ec579a26d25ac36; no voters:
I20260618 23:22:54.832275 20333 raft_consensus.cc:2781] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:22:54.832340 20333 raft_consensus.cc:482] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:22:54.832360 20333 raft_consensus.cc:3037] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:22:54.833096 20333 raft_consensus.cc:504] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } }
I20260618 23:22:54.833261 20333 leader_election.cc:288] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9 [CANDIDATE]: Term 1 election: Requested vote from peers 916ba07e6d814ce0b367c877761479a8 (127.3.217.131:41939), c2f459636e544ed48ec579a26d25ac36 (127.3.217.129:45297)
I20260618 23:22:54.833401 20003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0d172b400ac4c0fa62ef4ab1abdd5e3" candidate_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2f459636e544ed48ec579a26d25ac36"
I20260618 23:22:54.833420 20273 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0d172b400ac4c0fa62ef4ab1abdd5e3" candidate_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "916ba07e6d814ce0b367c877761479a8"
I20260618 23:22:54.833518 20003 raft_consensus.cc:3037] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:22:54.833514 20273 raft_consensus.cc:3037] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P 916ba07e6d814ce0b367c877761479a8 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:22:54.834194 20273 raft_consensus.cc:2454] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P 916ba07e6d814ce0b367c877761479a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09ef6e3f59e4f68847129aed9e2e9a9 in term 1.
I20260618 23:22:54.834383 20077 leader_election.cc:302] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 916ba07e6d814ce0b367c877761479a8, a09ef6e3f59e4f68847129aed9e2e9a9; no voters:
I20260618 23:22:54.834528 20333 raft_consensus.cc:2781] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:22:54.834702 20333 raft_consensus.cc:686] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9 [term 1 LEADER]: Becoming Leader. State: Replica: a09ef6e3f59e4f68847129aed9e2e9a9, State: Running, Role: LEADER
I20260618 23:22:54.834832 20003 raft_consensus.cc:2454] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a09ef6e3f59e4f68847129aed9e2e9a9 in term 1.
I20260618 23:22:54.834877 20333 consensus_queue.cc:237] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } }
I20260618 23:22:54.835740 19860 catalog_manager.cc:5495] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a09ef6e3f59e4f68847129aed9e2e9a9 (127.3.217.130). New cstate: current_term: 1 leader_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } health_report { overall_health: UNKNOWN } } }
I20260618 23:22:54.850807 20327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:54.847761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36638 (local address 127.3.217.130:36205)
0618 23:22:54.847877 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0618 23:22:54.847883 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0618 23:22:54.847895 (+ 12us) server_negotiation.cc:407] Connection header received
0618 23:22:54.847930 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:22:54.847930 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:22:54.847948 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:22:54.848024 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:22:54.848304 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.848773 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.849554 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:22:54.849746 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:22:54.849810 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:22:54.850305 (+ 495us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:22:54.850405 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:22:54.850482 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0618 23:22:54.850567 (+ 85us) server_negotiation.cc:299] Negotiation successful
0618 23:22:54.850638 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260618 23:22:54.853060 20003 raft_consensus.cc:1261] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Refusing update from remote peer a09ef6e3f59e4f68847129aed9e2e9a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:22:54.853116 20273 raft_consensus.cc:1261] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P 916ba07e6d814ce0b367c877761479a8 [term 1 FOLLOWER]: Refusing update from remote peer a09ef6e3f59e4f68847129aed9e2e9a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:22:54.853529 20336 consensus_queue.cc:1035] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:22:54.853705 20333 consensus_queue.cc:1035] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:22:54.856262 20340 mvcc.cc:205] Tried to move back new op lower bound from 7298355096994197504 to 7298355096924229632. Current Snapshot: MvccSnapshot[applied={T|T < 7298355096994197504}]
I20260618 23:22:54.856994 20341 mvcc.cc:205] Tried to move back new op lower bound from 7298355096994197504 to 7298355096924229632. Current Snapshot: MvccSnapshot[applied={T|T < 7298355096994197504}]
I20260618 23:22:54.859380 19860 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:22:54.859464 19860 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:22:54.860414 19860 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737: Sending DeleteTablet for 3 replicas of tablet a0d172b400ac4c0fa62ef4ab1abdd5e3
I20260618 23:22:54.860728 19983 tablet_service.cc:1514] Processing DeleteTablet for tablet a0d172b400ac4c0fa62ef4ab1abdd5e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:22:54 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:39624
I20260618 23:22:54.860857 20121 tablet_service.cc:1514] Processing DeleteTablet for tablet a0d172b400ac4c0fa62ef4ab1abdd5e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:22:54 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:36634
I20260618 23:22:54.860770 20253 tablet_service.cc:1514] Processing DeleteTablet for tablet a0d172b400ac4c0fa62ef4ab1abdd5e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:22:54 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:55448
I20260618 23:22:54.861052 20058 tablet_replica.cc:330] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36: stopping tablet replica
I20260618 23:22:54.861099 20348 tablet_replica.cc:330] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9: stopping tablet replica
I20260618 23:22:54.861110 20058 raft_consensus.cc:2229] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:22:54.861171 20058 raft_consensus.cc:2258] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:22:54.861186 20348 raft_consensus.cc:2229] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9 [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:22:54.861304 20348 raft_consensus.cc:2258] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:22:54.861436 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 19899
I20260618 23:22:54.861533 20349 tablet_replica.cc:330] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P 916ba07e6d814ce0b367c877761479a8: stopping tablet replica
I20260618 23:22:54.861550 20058 ts_tablet_manager.cc:1905] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:22:54.861640 20349 raft_consensus.cc:2229] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P 916ba07e6d814ce0b367c877761479a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:22:54.861739 20349 raft_consensus.cc:2258] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P 916ba07e6d814ce0b367c877761479a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:22:54.862285 20349 ts_tablet_manager.cc:1905] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P 916ba07e6d814ce0b367c877761479a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:22:54.862303 20348 ts_tablet_manager.cc:1905] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:22:54.864238 20348 ts_tablet_manager.cc:1918] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:22:54.864238 20349 ts_tablet_manager.cc:1918] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P 916ba07e6d814ce0b367c877761479a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:22:54.864315 20348 log.cc:1196] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/a0d172b400ac4c0fa62ef4ab1abdd5e3
I20260618 23:22:54.864323 20349 log.cc:1196] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P 916ba07e6d814ce0b367c877761479a8: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/a0d172b400ac4c0fa62ef4ab1abdd5e3
I20260618 23:22:54.864604 20348 ts_tablet_manager.cc:1939] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P a09ef6e3f59e4f68847129aed9e2e9a9: Deleting consensus metadata
I20260618 23:22:54.864604 20349 ts_tablet_manager.cc:1939] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P 916ba07e6d814ce0b367c877761479a8: Deleting consensus metadata
I20260618 23:22:54.865077 19848 catalog_manager.cc:4841] TS 916ba07e6d814ce0b367c877761479a8 (127.3.217.131:41939): tablet a0d172b400ac4c0fa62ef4ab1abdd5e3 (table test-table [id=9c5ec0df30cf4dc98a800c0de239d5bb]) successfully deleted
I20260618 23:22:54.865250 19846 catalog_manager.cc:4841] TS a09ef6e3f59e4f68847129aed9e2e9a9 (127.3.217.130:36205): tablet a0d172b400ac4c0fa62ef4ab1abdd5e3 (table test-table [id=9c5ec0df30cf4dc98a800c0de239d5bb]) successfully deleted
W20260618 23:22:54.867446 19847 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.217.129:45297 (error 108)
I20260618 23:22:54.867726 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 20055
I20260618 23:22:54.867952 20056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:22:54.867839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:45297 (local address 127.0.0.1:39634)
0618 23:22:54.867883 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0618 23:22:54.867917 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.129:45297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260618 23:22:54.868389 19847 catalog_manager.cc:4584] TS c2f459636e544ed48ec579a26d25ac36 (127.3.217.129:45297): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a0d172b400ac4c0fa62ef4ab1abdd5e3: Network error: Client connection negotiation failed: client connection to 127.3.217.129:45297: connect: Connection refused (error 111)
I20260618 23:22:54.873984 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 20190
I20260618 23:22:54.879377 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 19828
I20260618 23:23:14.885775 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:37653
--webserver_interface=127.3.217.190
--webserver_port=45635
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:38745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:37653
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:14.967602 20351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:14.967883 20351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:14.967929 20351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:14.969852 20351 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260618 23:23:14.969940 20351 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260618 23:23:14.969965 20351 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260618 23:23:14.969985 20351 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:23:14.970017 20351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:14.970043 20351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:14.970060 20351 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:23:14.970086 20351 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:23:14.971774 20351 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:38745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:37653
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:37653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=45635
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:14.972067 20351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:14.972306 20351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:14.978834 20357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:14.978860 20359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:14.978860 20356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:14.978909 20351 server_base.cc:1034] running on GCE node
I20260618 23:23:14.979256 20351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:14.979568 20351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:14.980754 20351 hybrid_clock.cc:648] HybridClock initialized: now 1781824994980676 us; error 81 us; skew 500 ppm
Jun 18 23:23:14 dist-test-slave-r9ct krb5kdc[19280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824994, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:14.984268 20351 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:23:14.984766 20351 webserver.cc:460] Webserver started at http://127.3.217.190:45635/ using document root <none> and password file <none>
I20260618 23:23:14.984990 20351 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:14.985059 20351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:14.986598 20351 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:14.987545 20366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:14.987819 20351 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:23:14.987947 20351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "6411182249714edf99af8f7055968737"
format_stamp: "Formatted at 2026-06-18 23:22:33 on dist-test-slave-r9ct"
server_key: "fdafc0ca7e65472b614763de85e60ed7"
server_key_iv: "86e63c2691c3b01b6144a6b3b7c63c4e"
server_key_version: "encryptionkey@0"
I20260618 23:23:14.988355 20351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:15.007567 20351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:15.010156 20351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:15.010403 20351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:15.015297 20351 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:37653
I20260618 23:23:15.015410 20418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:37653 every 8 connection(s)
I20260618 23:23:15.015928 20351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:23:15.017534 20419 sys_catalog.cc:263] Verifying existing consensus state
I20260618 23:23:15.018224 20419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737: Bootstrap starting.
I20260618 23:23:15.021503 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 20351
I20260618 23:23:15.021860 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:45297
--local_ip_for_outbound_sockets=127.3.217.129
--tserver_master_addrs=127.3.217.190:37653
--webserver_port=37049
--webserver_interface=127.3.217.129
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:38745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260618 23:23:15.027529 20419 log.cc:824] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:15.029793 20419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260618 23:23:15.030130 20419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737: Bootstrap complete.
I20260618 23:23:15.032423 20419 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6411182249714edf99af8f7055968737" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37653 } }
I20260618 23:23:15.032634 20419 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6411182249714edf99af8f7055968737, State: Initialized, Role: FOLLOWER
I20260618 23:23:15.032799 20419 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6411182249714edf99af8f7055968737" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37653 } }
I20260618 23:23:15.032867 20419 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:23:15.032925 20419 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:23:15.032975 20419 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 2 FOLLOWER]: Advancing to term 3
I20260618 23:23:15.033937 20419 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6411182249714edf99af8f7055968737" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37653 } }
I20260618 23:23:15.034021 20419 leader_election.cc:302] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6411182249714edf99af8f7055968737; no voters:
I20260618 23:23:15.034222 20419 leader_election.cc:288] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260618 23:23:15.034271 20423 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 3 FOLLOWER]: Leader election won for term 3
I20260618 23:23:15.034409 20423 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [term 3 LEADER]: Becoming Leader. State: Replica: 6411182249714edf99af8f7055968737, State: Running, Role: LEADER
I20260618 23:23:15.034484 20419 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:23:15.034497 20423 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6411182249714edf99af8f7055968737" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37653 } }
I20260618 23:23:15.034874 20423 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6411182249714edf99af8f7055968737. Latest consensus state: current_term: 3 leader_uuid: "6411182249714edf99af8f7055968737" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6411182249714edf99af8f7055968737" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37653 } } }
I20260618 23:23:15.034950 20423 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:15.035140 20429 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:23:15.034894 20424 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "6411182249714edf99af8f7055968737" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6411182249714edf99af8f7055968737" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37653 } } }
I20260618 23:23:15.035522 20424 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:15.035842 20429 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:23:15.035939 20429 catalog_manager.cc:1259] Loaded cluster ID: ba811f21f807407a86c1447f5ab34667
I20260618 23:23:15.035970 20429 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:23:15.037170 20429 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:23:15.037335 20429 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737: Loaded TSK: 0
I20260618 23:23:15.037379 20429 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6411182249714edf99af8f7055968737: Loaded TSK: 1
F20260618 23:23:15.037586 20429 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f5a82fde9ad google::LogMessage::Fail() at ??:0
@ 0x7f5a82fe188a google::LogMessage::SendToLog() at ??:0
@ 0x7f5a82fde4de google::LogMessage::Flush() at ??:0
@ 0x7f5a82fdfa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f5a8574b104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f5a85748d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f5a8af381cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f5a8af3848e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f5a8af38594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f5a8aefec48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f5a8af08ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f5a84eac0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f5a84ea1954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f5a85d056db start_thread at ??:0
@ 0x7f5a81adc61f clone at ??:0
W20260618 23:23:15.128002 20421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:15.128222 20421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:15.128258 20421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:15.129377 20421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:15.129442 20421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:15.129495 20421 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:23:15.131001 20421 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:38745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:45297
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=37049
--tserver_master_addrs=127.3.217.190:37653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:15.131259 20421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:15.131521 20421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:15.136822 20460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:15.136834 20461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:15.137014 20421 server_base.cc:1034] running on GCE node
W20260618 23:23:15.137042 20463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:15.137326 20421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:15.137578 20421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:15.138809 20421 hybrid_clock.cc:648] HybridClock initialized: now 1781824995138744 us; error 80 us; skew 500 ppm
Jun 18 23:23:15 dist-test-slave-r9ct krb5kdc[19280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824995, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:15.141991 20421 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:23:15.142480 20421 webserver.cc:460] Webserver started at http://127.3.217.129:37049/ using document root <none> and password file <none>
I20260618 23:23:15.142776 20421 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:15.142839 20421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:15.144618 20421 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260618 23:23:15.146862 20470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:15.147145 20421 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260618 23:23:15.147236 20421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "c2f459636e544ed48ec579a26d25ac36"
format_stamp: "Formatted at 2026-06-18 23:22:33 on dist-test-slave-r9ct"
server_key: "cf8ba9ae4757f82484a60e0f8f93e3b3"
server_key_iv: "ad87a3a812c8ed4964400a8df7a843d3"
server_key_version: "encryptionkey@0"
I20260618 23:23:15.147729 20421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:15.172705 20421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:15.175523 20421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:15.175742 20421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:15.176036 20421 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:23:15.176620 20477 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260618 23:23:15.178817 20421 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260618 23:23:15.178944 20421 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260618 23:23:15.179071 20421 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260618 23:23:15.180075 20421 ts_tablet_manager.cc:610] Registered 1 tablets
I20260618 23:23:15.180187 20421 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:15.180204 20477 tablet_bootstrap.cc:492] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36: Bootstrap starting.
I20260618 23:23:15.182457 20477 log.cc:824] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:15.185822 20477 tablet_bootstrap.cc:492] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260618 23:23:15.186193 20477 tablet_bootstrap.cc:492] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36: Bootstrap complete.
I20260618 23:23:15.186355 20477 ts_tablet_manager.cc:1397] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260618 23:23:15.187392 20421 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:45297
I20260618 23:23:15.187748 20421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:23:15.188351 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 20421
I20260618 23:23:15.188647 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:36205
--local_ip_for_outbound_sockets=127.3.217.130
--tserver_master_addrs=127.3.217.190:37653
--webserver_port=43095
--webserver_interface=127.3.217.130
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:38745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260618 23:23:15.189400 20477 raft_consensus.cc:348] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } }
I20260618 23:23:15.189935 20477 raft_consensus.cc:729] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2f459636e544ed48ec579a26d25ac36, State: Initialized, Role: FOLLOWER
I20260618 23:23:15.190184 20477 consensus_queue.cc:260] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } }
I20260618 23:23:15.190557 20477 ts_tablet_manager.cc:1428] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260618 23:23:15.190937 20585 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:45297 every 8 connection(s)
W20260618 23:23:15.277989 20588 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:23:15.188415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.129:45797)
0618 23:23:15.188597 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:15.188644 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:15.189391 (+ 747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:15.277767 (+ 88376us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":80,"threads_started":1}
W20260618 23:23:15.278203 20586 heartbeater.cc:644] Failed to heartbeat to 127.3.217.190:37653 (0 consecutive failures): Network error: Failed to ping master at 127.3.217.190:37653: Client connection negotiation failed: client connection to 127.3.217.190:37653: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260618 23:23:15.278563 20588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:15.278426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.129:60739)
0618 23:23:15.278485 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:15.278534 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260618 23:23:15.278959 20588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:15.278857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.129:36545)
0618 23:23:15.278907 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:15.278937 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260618 23:23:15.279289 20586 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260618 23:23:15.283342 20589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:15.283535 20589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:15.283560 20589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:15.284675 20589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:15.284724 20589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:15.284752 20589 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:23:15.286180 20589 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:38745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:36205
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=43095
--tserver_master_addrs=127.3.217.190:37653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20589
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:15.286405 20589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:15.286628 20589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:15.291689 20596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:15.291689 20598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:15.291847 20589 server_base.cc:1034] running on GCE node
W20260618 23:23:15.291805 20595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:15.292151 20589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:15.292429 20589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:15.293610 20589 hybrid_clock.cc:648] HybridClock initialized: now 1781824995293572 us; error 58 us; skew 500 ppm
Jun 18 23:23:15 dist-test-slave-r9ct krb5kdc[19280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824995, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:15.296353 20589 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:23:15.296862 20589 webserver.cc:460] Webserver started at http://127.3.217.130:43095/ using document root <none> and password file <none>
I20260618 23:23:15.297091 20589 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:15.297149 20589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:15.299026 20589 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:15.299835 20605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:15.300091 20589 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:15.300175 20589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "a09ef6e3f59e4f68847129aed9e2e9a9"
format_stamp: "Formatted at 2026-06-18 23:22:33 on dist-test-slave-r9ct"
server_key: "8935bc5649487b24ee87be949fd2453c"
server_key_iv: "7bb37d3b2e3ec4721233a0b9f2ffd2d7"
server_key_version: "encryptionkey@0"
I20260618 23:23:15.300565 20589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:15.313199 20589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:15.315516 20589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:15.315750 20589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:15.316004 20589 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:23:15.316310 20589 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:23:15.316344 20589 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:15.316385 20589 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:23:15.316413 20589 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:15.322453 20589 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:36205
I20260618 23:23:15.322520 20718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:36205 every 8 connection(s)
I20260618 23:23:15.322866 20589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:23:15.324201 20721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:15.323810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.130:56377)
0618 23:23:15.323991 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:15.324063 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":76,"threads_started":1}
W20260618 23:23:15.324640 20719 heartbeater.cc:644] Failed to heartbeat to 127.3.217.190:37653 (0 consecutive failures): Network error: Failed to ping master at 127.3.217.190:37653: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
I20260618 23:23:15.324926 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 20589
I20260618 23:23:15.325271 20721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:15.325176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.130:59845)
0618 23:23:15.325226 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:15.325254 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260618 23:23:15.325281 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:41939
--local_ip_for_outbound_sockets=127.3.217.131
--tserver_master_addrs=127.3.217.190:37653
--webserver_port=41533
--webserver_interface=127.3.217.131
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:38745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260618 23:23:15.325604 20721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:15.325515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.130:33823)
0618 23:23:15.325560 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:15.325589 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260618 23:23:15.325714 20719 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260618 23:23:15.412607 20722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:15.412803 20722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:15.412827 20722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:15.413908 20722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:15.413944 20722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:15.413969 20722 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:23:15.415395 20722 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:38745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:41939
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=41533
--tserver_master_addrs=127.3.217.190:37653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:15.415572 20722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:15.415745 20722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:15.421145 20727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:15.421284 20728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:15.421161 20730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:15.421717 20722 server_base.cc:1034] running on GCE node
I20260618 23:23:15.422066 20722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:15.422406 20722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:15.423621 20722 hybrid_clock.cc:648] HybridClock initialized: now 1781824995423579 us; error 64 us; skew 500 ppm
Jun 18 23:23:15 dist-test-slave-r9ct krb5kdc[19280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824995, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:15.431734 20722 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:23:15.432255 20722 webserver.cc:460] Webserver started at http://127.3.217.131:41533/ using document root <none> and password file <none>
I20260618 23:23:15.432510 20722 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:15.432580 20722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:15.434041 20722 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:23:15.434878 20737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:15.435524 20722 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260618 23:23:15.435655 20722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "916ba07e6d814ce0b367c877761479a8"
format_stamp: "Formatted at 2026-06-18 23:22:33 on dist-test-slave-r9ct"
server_key: "0c9c1ca5e28c3e323a246c0c3a227696"
server_key_iv: "be65de8f255264c1a1db283e5b7d9fdb"
server_key_version: "encryptionkey@0"
I20260618 23:23:15.436041 20722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:15.450670 20722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:15.453086 20722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:15.453199 20722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:15.453502 20722 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:23:15.453821 20722 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:23:15.453860 20722 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:15.453882 20722 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:23:15.453895 20722 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:15.460718 20722 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:41939
I20260618 23:23:15.460774 20850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:41939 every 8 connection(s)
I20260618 23:23:15.461114 20722 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:23:15.462435 20853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:15.461751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.131:54977)
0618 23:23:15.462078 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:15.462213 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":79,"threads_started":1}
W20260618 23:23:15.463012 20851 heartbeater.cc:644] Failed to heartbeat to 127.3.217.190:37653 (0 consecutive failures): Network error: Failed to ping master at 127.3.217.190:37653: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
I20260618 23:23:15.463467 20853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:15.463353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.131:35225)
0618 23:23:15.463409 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:15.463444 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260618 23:23:15.464115 20853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:15.463969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.131:35345)
0618 23:23:15.464040 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:15.464083 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260618 23:23:15.464329 20851 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260618 23:23:15.471402 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 20722
I20260618 23:23:16.280102 20855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:16.279868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.129:46691)
0618 23:23:16.280005 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:16.280043 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":61,"threads_started":1}
I20260618 23:23:16.326515 20856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:16.326205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.130:47813)
0618 23:23:16.326422 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:16.326465 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":128,"threads_started":1}
I20260618 23:23:16.431439 20857 raft_consensus.cc:482] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:23:16.431560 20857 raft_consensus.cc:504] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } }
I20260618 23:23:16.431998 20857 leader_election.cc:288] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 916ba07e6d814ce0b367c877761479a8 (127.3.217.131:41939), a09ef6e3f59e4f68847129aed9e2e9a9 (127.3.217.130:36205)
Jun 18 23:23:16 dist-test-slave-r9ct krb5kdc[19280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824995, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.131@KRBTEST.COM
Jun 18 23:23:16 dist-test-slave-r9ct krb5kdc[19280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781824995, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.130@KRBTEST.COM
I20260618 23:23:16.442673 20855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:16.432204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:41939 (local address 127.3.217.129:59943)
0618 23:23:16.432260 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:16.432272 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:16.432330 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:16.433219 (+ 889us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:16.433222 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:16.433585 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:23:16.433984 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:16.433987 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:16.435107 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:16.435108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:16.435740 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:16.435742 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:16.436410 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:16.436411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:16.436532 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:16.437175 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:23:16.437179 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:23:16.438810 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:23:16.440961 (+ 2151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:23:16.440967 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:23:16.440969 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:23:16.441248 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:23:16.441541 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:23:16.441541 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:23:16.441542 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:23:16.441682 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:23:16.442157 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:23:16.442163 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:23:16.442297 (+ 134us) client_negotiation.cc:769] Sending connection context
0618 23:23:16.442406 (+ 109us) client_negotiation.cc:240] Negotiation successful
0618 23:23:16.442568 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":14}
I20260618 23:23:16.442864 20858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:16.432261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:36205 (local address 127.3.217.129:47831)
0618 23:23:16.432379 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:16.432387 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:16.432433 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:16.433266 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:16.433267 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:16.433584 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:23:16.433813 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:16.433819 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:16.434953 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:16.434954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:16.435737 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:16.435739 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:16.436449 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:16.436450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:16.436534 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:16.437105 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:23:16.437114 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:23:16.439265 (+ 2151us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:23:16.441341 (+ 2076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:23:16.441342 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:23:16.441343 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:23:16.441572 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:23:16.441845 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:23:16.441846 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:23:16.441846 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:23:16.441903 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:23:16.442371 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:23:16.442372 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:23:16.442455 (+ 83us) client_negotiation.cc:769] Sending connection context
0618 23:23:16.442550 (+ 95us) client_negotiation.cc:240] Negotiation successful
0618 23:23:16.442657 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"mutex_wait_us":1,"thread_start_us":57,"threads_started":1}
I20260618 23:23:16.442893 20860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:16.432366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:47831 (local address 127.3.217.130:36205)
0618 23:23:16.432514 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:16.432528 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:16.432554 (+ 26us) server_negotiation.cc:407] Connection header received
0618 23:23:16.432979 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:16.432981 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:16.433021 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:16.433156 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:16.433921 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:16.434854 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:16.435839 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:16.436383 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:16.436481 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:16.439411 (+ 2930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:16.439414 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:16.439414 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:16.439423 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:16.441231 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:16.441656 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:16.441658 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:16.441659 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:16.441760 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:16.441966 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:16.441967 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:16.441967 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:16.442279 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:16.442364 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:16.442620 (+ 256us) server_negotiation.cc:299] Negotiation successful
0618 23:23:16.442774 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":69,"threads_started":1}
I20260618 23:23:16.443156 20859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:16.432341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:59943 (local address 127.3.217.131:41939)
0618 23:23:16.432508 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:16.432518 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:16.432537 (+ 19us) server_negotiation.cc:407] Connection header received
0618 23:23:16.432979 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:16.432982 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:16.433029 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:16.433179 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:16.434095 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:16.435010 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:16.435838 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:16.436337 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:16.436440 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:16.439100 (+ 2660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:16.439105 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:16.439105 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:16.439121 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:16.440870 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:16.441349 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:16.441352 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:16.441352 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:16.441459 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:16.441763 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:16.441764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:16.441764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:16.442087 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:16.442147 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:16.442510 (+ 363us) server_negotiation.cc:299] Negotiation successful
0618 23:23:16.442658 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":65,"threads_started":1}
W20260618 23:23:16.443959 20474 leader_election.cc:341] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 916ba07e6d814ce0b367c877761479a8 (127.3.217.131:41939): Not found: Tablet not found: a0d172b400ac4c0fa62ef4ab1abdd5e3
W20260618 23:23:16.444043 20472 leader_election.cc:341] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a09ef6e3f59e4f68847129aed9e2e9a9 (127.3.217.130:36205): Not found: Tablet not found: a0d172b400ac4c0fa62ef4ab1abdd5e3
I20260618 23:23:16.444144 20472 leader_election.cc:302] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2f459636e544ed48ec579a26d25ac36; no voters: 916ba07e6d814ce0b367c877761479a8, a09ef6e3f59e4f68847129aed9e2e9a9
I20260618 23:23:16.444342 20857 raft_consensus.cc:2726] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260618 23:23:16.464993 20861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:16.464772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.131:37843)
0618 23:23:16.464902 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:16.464957 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":90,"threads_started":1}
I20260618 23:23:17.281194 20862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:17.280784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.129:48795)
0618 23:23:17.281055 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:17.281115 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":121,"threads_started":1}
I20260618 23:23:17.327239 20863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:17.326992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.130:48703)
0618 23:23:17.327154 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:17.327195 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":87,"threads_started":1}
I20260618 23:23:17.465662 20864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:17.465442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.131:46875)
0618 23:23:17.465589 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:17.465625 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":56,"threads_started":1}
I20260618 23:23:18.282068 20865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:18.281790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.129:57035)
0618 23:23:18.281968 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:18.282015 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":68,"threads_started":1}
I20260618 23:23:18.328022 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:18.327772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.130:60645)
0618 23:23:18.327939 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:18.327978 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":63,"threads_started":1}
I20260618 23:23:18.398440 20867 raft_consensus.cc:482] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:23:18.398533 20867 raft_consensus.cc:504] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } }
I20260618 23:23:18.398725 20867 leader_election.cc:288] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 916ba07e6d814ce0b367c877761479a8 (127.3.217.131:41939), a09ef6e3f59e4f68847129aed9e2e9a9 (127.3.217.130:36205)
W20260618 23:23:18.399169 20472 leader_election.cc:341] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a09ef6e3f59e4f68847129aed9e2e9a9 (127.3.217.130:36205): Not found: Tablet not found: a0d172b400ac4c0fa62ef4ab1abdd5e3
W20260618 23:23:18.399255 20474 leader_election.cc:341] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 916ba07e6d814ce0b367c877761479a8 (127.3.217.131:41939): Not found: Tablet not found: a0d172b400ac4c0fa62ef4ab1abdd5e3
I20260618 23:23:18.399312 20474 leader_election.cc:302] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2f459636e544ed48ec579a26d25ac36; no voters: 916ba07e6d814ce0b367c877761479a8, a09ef6e3f59e4f68847129aed9e2e9a9
I20260618 23:23:18.399400 20867 raft_consensus.cc:2726] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260618 23:23:18.466393 20868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:18.466157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.131:50957)
0618 23:23:18.466313 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:18.466350 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":73,"threads_started":1}
I20260618 23:23:19.283109 20869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:19.282851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.129:40801)
0618 23:23:19.283017 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:19.283063 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":79,"threads_started":1}
I20260618 23:23:19.329075 20870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:19.328707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.130:57171)
0618 23:23:19.328942 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:19.329009 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":96,"threads_started":1}
I20260618 23:23:19.467170 20871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:19.466929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.131:54549)
0618 23:23:19.467083 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:19.467129 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":72,"threads_started":1}
I20260618 23:23:20.082392 20872 raft_consensus.cc:482] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:23:20.082516 20872 raft_consensus.cc:504] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } }
I20260618 23:23:20.082700 20872 leader_election.cc:288] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 916ba07e6d814ce0b367c877761479a8 (127.3.217.131:41939), a09ef6e3f59e4f68847129aed9e2e9a9 (127.3.217.130:36205)
W20260618 23:23:20.083127 20474 leader_election.cc:341] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 916ba07e6d814ce0b367c877761479a8 (127.3.217.131:41939): Not found: Tablet not found: a0d172b400ac4c0fa62ef4ab1abdd5e3
W20260618 23:23:20.083204 20472 leader_election.cc:341] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a09ef6e3f59e4f68847129aed9e2e9a9 (127.3.217.130:36205): Not found: Tablet not found: a0d172b400ac4c0fa62ef4ab1abdd5e3
I20260618 23:23:20.083271 20472 leader_election.cc:302] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2f459636e544ed48ec579a26d25ac36; no voters: 916ba07e6d814ce0b367c877761479a8, a09ef6e3f59e4f68847129aed9e2e9a9
I20260618 23:23:20.083346 20872 raft_consensus.cc:2726] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260618 23:23:20.283818 20873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:20.283603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.129:53325)
0618 23:23:20.283737 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:20.283773 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":58,"threads_started":1}
I20260618 23:23:20.329986 20874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:20.329620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.130:54499)
0618 23:23:20.329825 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:20.329908 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":77,"threads_started":1}
I20260618 23:23:20.468124 20875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:20.467863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.131:48733)
0618 23:23:20.468004 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:20.468069 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":75,"threads_started":1}
I20260618 23:23:21.284670 20876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:21.284445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.129:43895)
0618 23:23:21.284583 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:21.284625 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":60,"threads_started":1}
I20260618 23:23:21.331094 20877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:21.330842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.130:34641)
0618 23:23:21.331004 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:21.331037 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":70,"threads_started":1}
I20260618 23:23:21.468827 20878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:21.468596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.131:49567)
0618 23:23:21.468742 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:21.468785 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":61,"threads_started":1}
I20260618 23:23:21.606640 20879 raft_consensus.cc:482] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:23:21.606815 20879 raft_consensus.cc:504] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } }
I20260618 23:23:21.607018 20879 leader_election.cc:288] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 916ba07e6d814ce0b367c877761479a8 (127.3.217.131:41939), a09ef6e3f59e4f68847129aed9e2e9a9 (127.3.217.130:36205)
W20260618 23:23:21.607437 20474 leader_election.cc:341] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 916ba07e6d814ce0b367c877761479a8 (127.3.217.131:41939): Not found: Tablet not found: a0d172b400ac4c0fa62ef4ab1abdd5e3
W20260618 23:23:21.607508 20472 leader_election.cc:341] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a09ef6e3f59e4f68847129aed9e2e9a9 (127.3.217.130:36205): Not found: Tablet not found: a0d172b400ac4c0fa62ef4ab1abdd5e3
I20260618 23:23:21.607565 20474 leader_election.cc:302] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2f459636e544ed48ec579a26d25ac36; no voters: 916ba07e6d814ce0b367c877761479a8, a09ef6e3f59e4f68847129aed9e2e9a9
I20260618 23:23:21.607645 20879 raft_consensus.cc:2726] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260618 23:23:22.285602 20880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:22.285330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.129:50175)
0618 23:23:22.285509 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:22.285556 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":65,"threads_started":1}
I20260618 23:23:22.332330 20881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:22.331903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.130:34085)
0618 23:23:22.332143 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:22.332270 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":147,"threads_started":1}
I20260618 23:23:22.469836 20882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:22.469592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.131:39979)
0618 23:23:22.469739 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:22.469789 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":82,"threads_started":1}
I20260618 23:23:23.286437 20883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:23.286152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.129:35881)
0618 23:23:23.286352 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:23.286388 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":66,"threads_started":1}
I20260618 23:23:23.333222 20884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:23.332995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.130:43589)
0618 23:23:23.333135 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:23.333173 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":63,"threads_started":1}
I20260618 23:23:23.470954 20885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:23.470741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.131:55187)
0618 23:23:23.470870 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:23.470909 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":60,"threads_started":1}
I20260618 23:23:24.287213 20886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:24.286997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.129:51447)
0618 23:23:24.287127 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:24.287167 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":68,"threads_started":1}
I20260618 23:23:24.333992 20887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:24.333749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.130:51025)
0618 23:23:24.333906 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:24.333941 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":71,"threads_started":1}
I20260618 23:23:24.471683 20888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:24.471448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.131:45131)
0618 23:23:24.471600 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:24.471637 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":76,"threads_started":1}
I20260618 23:23:25.288300 20889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:25.288005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.129:58543)
0618 23:23:25.288148 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:25.288239 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":95,"threads_started":1}
I20260618 23:23:25.334921 20890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:25.334668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.130:37719)
0618 23:23:25.334817 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:25.334857 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":86,"threads_started":1}
I20260618 23:23:25.472565 20891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:25.472330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.131:55529)
0618 23:23:25.472486 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:25.472520 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":75,"threads_started":1}
I20260618 23:23:26.289126 20892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:26.288839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.129:52371)
0618 23:23:26.289036 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:26.289078 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":77,"threads_started":1}
I20260618 23:23:26.335644 20893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:26.335424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.130:40525)
0618 23:23:26.335565 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:26.335602 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":80,"threads_started":1}
I20260618 23:23:26.473402 20894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:26.473166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.131:53587)
0618 23:23:26.473318 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:26.473357 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":75,"threads_started":1}
I20260618 23:23:26.814139 20895 raft_consensus.cc:482] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:23:26.814281 20895 raft_consensus.cc:504] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "916ba07e6d814ce0b367c877761479a8" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41939 } } peers { permanent_uuid: "a09ef6e3f59e4f68847129aed9e2e9a9" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 36205 } } peers { permanent_uuid: "c2f459636e544ed48ec579a26d25ac36" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45297 } }
I20260618 23:23:26.814492 20895 leader_election.cc:288] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 916ba07e6d814ce0b367c877761479a8 (127.3.217.131:41939), a09ef6e3f59e4f68847129aed9e2e9a9 (127.3.217.130:36205)
W20260618 23:23:26.814917 20474 leader_election.cc:341] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 916ba07e6d814ce0b367c877761479a8 (127.3.217.131:41939): Not found: Tablet not found: a0d172b400ac4c0fa62ef4ab1abdd5e3
W20260618 23:23:26.815017 20472 leader_election.cc:341] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a09ef6e3f59e4f68847129aed9e2e9a9 (127.3.217.130:36205): Not found: Tablet not found: a0d172b400ac4c0fa62ef4ab1abdd5e3
I20260618 23:23:26.815053 20472 leader_election.cc:302] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2f459636e544ed48ec579a26d25ac36; no voters: 916ba07e6d814ce0b367c877761479a8, a09ef6e3f59e4f68847129aed9e2e9a9
I20260618 23:23:26.815286 20895 raft_consensus.cc:2726] T a0d172b400ac4c0fa62ef4ab1abdd5e3 P c2f459636e544ed48ec579a26d25ac36 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260618 23:23:27.289918 20896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:27.289683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.129:36217)
0618 23:23:27.289819 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:27.289856 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":67,"threads_started":1}
I20260618 23:23:27.336633 20897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:27.336276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.130:58871)
0618 23:23:27.336487 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:27.336555 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":87,"threads_started":1}
I20260618 23:23:27.474419 20898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:27.474118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.131:46581)
0618 23:23:27.474293 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:27.474357 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":66,"threads_started":1}
I20260618 23:23:28.290693 20899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:28.290444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.129:35917)
0618 23:23:28.290607 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:28.290646 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":70,"threads_started":1}
I20260618 23:23:28.337405 20900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:28.337147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.130:51707)
0618 23:23:28.337314 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:28.337353 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":75,"threads_started":1}
I20260618 23:23:28.475574 20901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:28.475318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.131:47997)
0618 23:23:28.475489 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:28.475526 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":94,"threads_started":1}
I20260618 23:23:29.291617 20902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:29.291346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.129:34117)
0618 23:23:29.291522 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:29.291570 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":86,"threads_started":1}
I20260618 23:23:29.338289 20903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:29.337963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.130:41653)
0618 23:23:29.338175 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:29.338242 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":113,"threads_started":1}
I20260618 23:23:29.476526 20904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:29.476193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.131:44681)
0618 23:23:29.476439 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:29.476480 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":61,"threads_started":1}
I20260618 23:23:30.292632 20905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:30.292426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.129:52677)
0618 23:23:30.292553 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:30.292588 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":64,"threads_started":1}
I20260618 23:23:30.339231 20906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:30.339011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.130:46219)
0618 23:23:30.339144 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:30.339189 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":62,"threads_started":1}
I20260618 23:23:30.477378 20907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:30.477149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37653 (local address 127.3.217.131:59055)
0618 23:23:30.477287 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:30.477337 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.190:37653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":61,"threads_started":1}
I20260618 23:23:30.482535 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 20421
I20260618 23:23:30.487398 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 20589
I20260618 23:23:30.491674 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 20722
2026-06-18T23:23:30Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59242 ms)
[----------] 30 tests from SecurityITest (242053 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:23:31 dist-test-slave-r9ct krb5kdc[20910](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:23:31 dist-test-slave-r9ct krb5kdc[20910](info): set up 2 sockets
Jun 18 23:23:31 dist-test-slave-r9ct krb5kdc[20910](info): commencing operation
krb5kdc: starting...
W20260618 23:23:32.422458 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:23:32 dist-test-slave-r9ct krb5kdc[20910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:23:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:23:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:23:32.549304 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:41667
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:39579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:41667
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:32.629670 20923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:32.629928 20923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:32.629968 20923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:32.631111 20923 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:23:32.631184 20923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:32.631210 20923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:32.631251 20923 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:23:32.631276 20923 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:23:32.632725 20923 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:39579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:41667
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:41667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:32.632994 20923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:32.633219 20923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260618 23:23:32.638661 20923 server_base.cc:1034] running on GCE node
W20260618 23:23:32.638629 20929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:32.638620 20931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:32.638751 20928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:32.639254 20923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:32.639571 20923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:32.640766 20923 hybrid_clock.cc:648] HybridClock initialized: now 1781825012640741 us; error 40 us; skew 500 ppm
Jun 18 23:23:32 dist-test-slave-r9ct krb5kdc[20910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825012, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:32.643337 20923 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:23:32.643733 20923 webserver.cc:460] Webserver started at http://127.3.217.190:45193/ using document root <none> and password file <none>
I20260618 23:23:32.643959 20923 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:32.644025 20923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:32.644172 20923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:32.645215 20923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "0897375d99d04c2bb5237ad3d572e6c7"
format_stamp: "Formatted at 2026-06-18 23:23:32 on dist-test-slave-r9ct"
server_key: "0b7dcb46b22e90639ad37d46fefa3b4a"
server_key_iv: "541699c2daffedceb20d0b70deb2ac84"
server_key_version: "encryptionkey@0"
I20260618 23:23:32.645568 20923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "0897375d99d04c2bb5237ad3d572e6c7"
format_stamp: "Formatted at 2026-06-18 23:23:32 on dist-test-slave-r9ct"
server_key: "0b7dcb46b22e90639ad37d46fefa3b4a"
server_key_iv: "541699c2daffedceb20d0b70deb2ac84"
server_key_version: "encryptionkey@0"
I20260618 23:23:32.646957 20923 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:23:32.647893 20938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:32.648089 20923 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:32.648173 20923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "0897375d99d04c2bb5237ad3d572e6c7"
format_stamp: "Formatted at 2026-06-18 23:23:32 on dist-test-slave-r9ct"
server_key: "0b7dcb46b22e90639ad37d46fefa3b4a"
server_key_iv: "541699c2daffedceb20d0b70deb2ac84"
server_key_version: "encryptionkey@0"
I20260618 23:23:32.648265 20923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:32.676247 20923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:32.678675 20923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:32.678871 20923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:32.682849 20923 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:41667
I20260618 23:23:32.682927 20990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:41667 every 8 connection(s)
I20260618 23:23:32.683272 20923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:23:32.684094 20991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:32.684543 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 20923
I20260618 23:23:32.684684 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:23:32.684952 3942 external_mini_cluster.cc:1428] Setting key 2157e16c9804ba49b0f9576cd4d01160
I20260618 23:23:32.687825 20991 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7: Bootstrap starting.
I20260618 23:23:32.688510 20991 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:32.688810 20991 log.cc:824] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:32.689783 20991 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7: No bootstrap required, opened a new log
Jun 18 23:23:32 dist-test-slave-r9ct krb5kdc[20910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:23:32.692880 20991 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0897375d99d04c2bb5237ad3d572e6c7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41667 } }
I20260618 23:23:32.693049 20991 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:32.693075 20991 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0897375d99d04c2bb5237ad3d572e6c7, State: Initialized, Role: FOLLOWER
I20260618 23:23:32.693208 20991 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0897375d99d04c2bb5237ad3d572e6c7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41667 } }
I20260618 23:23:32.693293 20991 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:23:32.693327 20991 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:23:32.693373 20991 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:32.694067 20991 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0897375d99d04c2bb5237ad3d572e6c7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41667 } }
I20260618 23:23:32.694172 20991 leader_election.cc:302] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0897375d99d04c2bb5237ad3d572e6c7; no voters:
I20260618 23:23:32.694332 20991 leader_election.cc:288] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:23:32.694391 20996 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:32.694590 20996 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7 [term 1 LEADER]: Becoming Leader. State: Replica: 0897375d99d04c2bb5237ad3d572e6c7, State: Running, Role: LEADER
I20260618 23:23:32.694597 20991 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:23:32.694775 20996 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0897375d99d04c2bb5237ad3d572e6c7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41667 } }
I20260618 23:23:32.695416 20998 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0897375d99d04c2bb5237ad3d572e6c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0897375d99d04c2bb5237ad3d572e6c7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41667 } } }
I20260618 23:23:32.695483 20998 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7 [sys.catalog]: This master's current role is: LEADER
W20260618 23:23:32.696581 21011 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260618 23:23:32.696669 21011 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260618 23:23:32.696376 20997 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0897375d99d04c2bb5237ad3d572e6c7. Latest consensus state: current_term: 1 leader_uuid: "0897375d99d04c2bb5237ad3d572e6c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0897375d99d04c2bb5237ad3d572e6c7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 41667 } } }
I20260618 23:23:32.696724 20994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:32.685524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53088 (local address 127.3.217.190:41667)
0618 23:23:32.685713 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:32.685721 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:32.685745 (+ 24us) server_negotiation.cc:407] Connection header received
0618 23:23:32.686173 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:32.686179 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:32.686230 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:32.686348 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:32.687163 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:32.688125 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:32.689167 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:32.689647 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:32.689737 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:32.692454 (+ 2717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:32.692461 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:32.692462 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:32.692482 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:32.694925 (+ 2443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:32.695380 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:32.695383 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:32.695384 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:32.695490 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:32.695699 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:32.695700 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:32.695700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:32.695986 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:32.696209 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:32.696277 (+ 68us) server_negotiation.cc:299] Negotiation successful
0618 23:23:32.696411 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":92,"threads_started":1}
I20260618 23:23:32.696758 20997 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:32.696972 21013 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:23:32.697151 21013 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:23:32.698565 21013 catalog_manager.cc:1347] Generated new cluster ID: 731b0b649f264ed2974122769ad64131
I20260618 23:23:32.698614 21013 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:23:32.725772 21013 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:23:32.726402 21013 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:23:32.735255 21013 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7: Generated new TSK 0
I20260618 23:23:32.735488 21013 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.217.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
I20260618 23:23:32.769556 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:41667
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:39579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:32.870759 21017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:32.870970 21017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:32.871008 21017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:32.872133 21017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:32.872208 21017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:32.872251 21017 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:23:32.873672 21017 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:39579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:41667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21017
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:32.873936 21017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:32.874186 21017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:32.879282 21025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:32.879298 21023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:32.879345 21022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:32.879726 21017 server_base.cc:1034] running on GCE node
I20260618 23:23:32.879969 21017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:32.880216 21017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:32.881393 21017 hybrid_clock.cc:648] HybridClock initialized: now 1781825012881356 us; error 49 us; skew 500 ppm
Jun 18 23:23:32 dist-test-slave-r9ct krb5kdc[20910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825012, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:32.884383 21017 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:23:32.884878 21017 webserver.cc:460] Webserver started at http://127.3.217.129:44807/ using document root <none> and password file <none>
I20260618 23:23:32.885072 21017 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:32.885113 21017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:32.885198 21017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:32.886201 21017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "b3d7ccdc1ad64b6ba39f88681e3adf6a"
format_stamp: "Formatted at 2026-06-18 23:23:32 on dist-test-slave-r9ct"
server_key: "850e2508fbbf0c04e8c29d9054585476"
server_key_iv: "1dfb3ea214f1a59dc58807cf0f5dc605"
server_key_version: "encryptionkey@0"
I20260618 23:23:32.886484 21017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "b3d7ccdc1ad64b6ba39f88681e3adf6a"
format_stamp: "Formatted at 2026-06-18 23:23:32 on dist-test-slave-r9ct"
server_key: "850e2508fbbf0c04e8c29d9054585476"
server_key_iv: "1dfb3ea214f1a59dc58807cf0f5dc605"
server_key_version: "encryptionkey@0"
I20260618 23:23:32.887816 21017 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260618 23:23:32.888751 21032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:32.889024 21017 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:23:32.889098 21017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "b3d7ccdc1ad64b6ba39f88681e3adf6a"
format_stamp: "Formatted at 2026-06-18 23:23:32 on dist-test-slave-r9ct"
server_key: "850e2508fbbf0c04e8c29d9054585476"
server_key_iv: "1dfb3ea214f1a59dc58807cf0f5dc605"
server_key_version: "encryptionkey@0"
I20260618 23:23:32.889192 21017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:32.918639 21017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:32.920949 21017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:32.921092 21017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:32.921353 21017 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:23:32.921654 21017 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:23:32.921687 21017 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:32.921730 21017 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:23:32.921756 21017 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:32.927675 21017 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:34299
I20260618 23:23:32.927726 21145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:34299 every 8 connection(s)
I20260618 23:23:32.928014 21017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
Jun 18 23:23:32 dist-test-slave-r9ct krb5kdc[20910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825012, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:23:32.935460 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 21017
I20260618 23:23:32.935568 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:23:32.935793 3942 external_mini_cluster.cc:1428] Setting key af240f22d195262ec2e8b7ba7e727e5c
I20260618 23:23:32.938148 20994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:32.928703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:34391 (local address 127.3.217.190:41667)
0618 23:23:32.928762 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:32.928765 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:32.928984 (+ 219us) server_negotiation.cc:407] Connection header received
0618 23:23:32.929447 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:32.929448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:32.929458 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:32.929554 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:32.931095 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:32.931652 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:32.932723 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:32.932939 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:32.932999 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:32.935127 (+ 2128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:32.935128 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:32.935129 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:32.935135 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:32.936631 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:32.937147 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:32.937148 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:32.937148 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:32.937193 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:32.937452 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:32.937453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:32.937453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:32.937543 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:32.937590 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:32.937925 (+ 335us) server_negotiation.cc:299] Negotiation successful
0618 23:23:32.938026 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260618 23:23:32.938270 21148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:32.928700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:41667 (local address 127.3.217.129:34391)
0618 23:23:32.928879 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:32.928913 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:32.929359 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:32.929772 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:32.929778 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:32.930624 (+ 846us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:23:32.930997 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:32.931004 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:32.931781 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:32.931782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:32.932619 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:32.932621 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:32.933017 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:32.933018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:32.933118 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:32.933626 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:23:32.933634 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:23:32.935047 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:23:32.936713 (+ 1666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:23:32.936719 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:23:32.936721 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:23:32.937073 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:23:32.937255 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:23:32.937256 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:23:32.937256 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:23:32.937394 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:23:32.937601 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:23:32.937607 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:23:32.937766 (+ 159us) client_negotiation.cc:769] Sending connection context
0618 23:23:32.937888 (+ 122us) client_negotiation.cc:240] Negotiation successful
0618 23:23:32.938069 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":96,"threads_started":1}
I20260618 23:23:32.938758 21146 heartbeater.cc:347] Connected to a master server at 127.3.217.190:41667
I20260618 23:23:32.938870 21146 heartbeater.cc:464] Registering TS with master...
I20260618 23:23:32.939042 21146 heartbeater.cc:511] Master 127.3.217.190:41667 requested a full tablet report, sending...
I20260618 23:23:32.939626 20955 ts_manager.cc:194] Registered new tserver with Master: b3d7ccdc1ad64b6ba39f88681e3adf6a (127.3.217.129:34299)
I20260618 23:23:32.940557 20955 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:34391
WARNING: no policy specified for kudu/127.3.217.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
I20260618 23:23:32.962415 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:41667
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:39579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:33.043577 21151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:33.043809 21151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:33.043848 21151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:33.045029 21151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:33.045096 21151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:33.045142 21151 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:23:33.046586 21151 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:39579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:41667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:33.046865 21151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:33.047089 21151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:33.052030 21159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:33.052063 21157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:33.052030 21156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:33.052285 21151 server_base.cc:1034] running on GCE node
I20260618 23:23:33.052469 21151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:33.052759 21151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:33.053921 21151 hybrid_clock.cc:648] HybridClock initialized: now 1781825013053912 us; error 27 us; skew 500 ppm
Jun 18 23:23:33 dist-test-slave-r9ct krb5kdc[20910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825013, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:33.056367 21151 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:23:33.056821 21151 webserver.cc:460] Webserver started at http://127.3.217.130:45759/ using document root <none> and password file <none>
I20260618 23:23:33.057032 21151 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:33.057080 21151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:33.057215 21151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:33.058235 21151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "40442579c3554e90915767bfd17a3a81"
format_stamp: "Formatted at 2026-06-18 23:23:33 on dist-test-slave-r9ct"
server_key: "4d1a94347cc04ca8f926f67a6f2b6c01"
server_key_iv: "e03576223540939ef849ee14eaef8bed"
server_key_version: "encryptionkey@0"
I20260618 23:23:33.058573 21151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "40442579c3554e90915767bfd17a3a81"
format_stamp: "Formatted at 2026-06-18 23:23:33 on dist-test-slave-r9ct"
server_key: "4d1a94347cc04ca8f926f67a6f2b6c01"
server_key_iv: "e03576223540939ef849ee14eaef8bed"
server_key_version: "encryptionkey@0"
I20260618 23:23:33.059924 21151 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:23:33.060839 21166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:33.061157 21151 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:23:33.061237 21151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "40442579c3554e90915767bfd17a3a81"
format_stamp: "Formatted at 2026-06-18 23:23:33 on dist-test-slave-r9ct"
server_key: "4d1a94347cc04ca8f926f67a6f2b6c01"
server_key_iv: "e03576223540939ef849ee14eaef8bed"
server_key_version: "encryptionkey@0"
I20260618 23:23:33.061331 21151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:33.073144 21151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:33.075491 21151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:33.075662 21151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:33.075924 21151 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:23:33.076253 21151 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:23:33.076313 21151 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:33.076354 21151 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:23:33.076380 21151 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:33.082419 21151 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:44395
I20260618 23:23:33.082459 21279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:44395 every 8 connection(s)
I20260618 23:23:33.082857 21151 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:23:33.087316 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 21151
I20260618 23:23:33.087441 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:23:33.087638 3942 external_mini_cluster.cc:1428] Setting key 6730be1e56ea6682d30cdc504501462b
Jun 18 23:23:33 dist-test-slave-r9ct krb5kdc[20910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825013, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:23:33.092250 20994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:33.083545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:36497 (local address 127.3.217.190:41667)
0618 23:23:33.083622 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:33.083625 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:33.083798 (+ 173us) server_negotiation.cc:407] Connection header received
0618 23:23:33.084249 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:33.084250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:33.084259 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:33.084321 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:33.085229 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.085728 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.086743 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.086968 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.087057 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:33.089295 (+ 2238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:33.089297 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:33.089298 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:33.089305 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:33.090756 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:33.091162 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:33.091164 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:33.091164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:33.091221 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:33.091534 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:33.091535 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:33.091535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:33.091645 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:33.091799 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:33.092076 (+ 277us) server_negotiation.cc:299] Negotiation successful
0618 23:23:33.092163 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260618 23:23:33.092509 21282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:33.083523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:41667 (local address 127.3.217.130:36497)
0618 23:23:33.083674 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:33.083708 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:33.084166 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:33.084372 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:33.084375 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:33.084923 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:23:33.085108 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:33.085131 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.085832 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.085833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:33.086615 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:33.086617 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.087067 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.087068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:33.087205 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:33.087778 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:23:33.087785 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:23:33.089201 (+ 1416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:23:33.090858 (+ 1657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:23:33.090865 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:23:33.090867 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:23:33.091085 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:23:33.091310 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:23:33.091311 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:23:33.091311 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:23:33.091442 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:23:33.091799 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:23:33.091806 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:23:33.091939 (+ 133us) client_negotiation.cc:769] Sending connection context
0618 23:23:33.092043 (+ 104us) client_negotiation.cc:240] Negotiation successful
0618 23:23:33.092194 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":91,"threads_started":1}
I20260618 23:23:33.092958 21280 heartbeater.cc:347] Connected to a master server at 127.3.217.190:41667
I20260618 23:23:33.093047 21280 heartbeater.cc:464] Registering TS with master...
I20260618 23:23:33.093236 21280 heartbeater.cc:511] Master 127.3.217.190:41667 requested a full tablet report, sending...
I20260618 23:23:33.093580 20955 ts_manager.cc:194] Registered new tserver with Master: 40442579c3554e90915767bfd17a3a81 (127.3.217.130:44395)
I20260618 23:23:33.093964 20955 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:36497
WARNING: no policy specified for kudu/127.3.217.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
I20260618 23:23:33.114291 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:41667
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:39579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:33.199126 21285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:33.199342 21285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:33.199368 21285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:33.200589 21285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:33.200632 21285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:33.200659 21285 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:23:33.202071 21285 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:39579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:41667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:33.202323 21285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:33.202553 21285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:33.207468 21293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:33.207499 21291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:33.207466 21290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:33.207656 21285 server_base.cc:1034] running on GCE node
I20260618 23:23:33.207958 21285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:33.208194 21285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:33.209407 21285 hybrid_clock.cc:648] HybridClock initialized: now 1781825013209384 us; error 42 us; skew 500 ppm
Jun 18 23:23:33 dist-test-slave-r9ct krb5kdc[20910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825013, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:33.212097 21285 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:23:33.212529 21285 webserver.cc:460] Webserver started at http://127.3.217.131:46623/ using document root <none> and password file <none>
I20260618 23:23:33.212730 21285 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:33.212775 21285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:33.212864 21285 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:33.213917 21285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "851105f11bbf46a1968efe7d1f27eaeb"
format_stamp: "Formatted at 2026-06-18 23:23:33 on dist-test-slave-r9ct"
server_key: "87de105b085ab1590522b0081cb6c4ae"
server_key_iv: "18eb6c5d5bfe37aeec11924fef15d382"
server_key_version: "encryptionkey@0"
I20260618 23:23:33.214236 21285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "851105f11bbf46a1968efe7d1f27eaeb"
format_stamp: "Formatted at 2026-06-18 23:23:33 on dist-test-slave-r9ct"
server_key: "87de105b085ab1590522b0081cb6c4ae"
server_key_iv: "18eb6c5d5bfe37aeec11924fef15d382"
server_key_version: "encryptionkey@0"
I20260618 23:23:33.215642 21285 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260618 23:23:33.216624 21300 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:33.217087 21285 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:23:33.217281 21285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "851105f11bbf46a1968efe7d1f27eaeb"
format_stamp: "Formatted at 2026-06-18 23:23:33 on dist-test-slave-r9ct"
server_key: "87de105b085ab1590522b0081cb6c4ae"
server_key_iv: "18eb6c5d5bfe37aeec11924fef15d382"
server_key_version: "encryptionkey@0"
I20260618 23:23:33.217401 21285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:33.234841 21285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:33.237298 21285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:33.237457 21285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:33.237669 21285 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:23:33.237962 21285 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:23:33.237995 21285 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:33.238037 21285 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:23:33.238063 21285 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:33.243950 21285 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:37943
I20260618 23:23:33.244019 21413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:37943 every 8 connection(s)
I20260618 23:23:33.244336 21285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:23:33.249121 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 21285
I20260618 23:23:33.249305 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:23:33.249527 3942 external_mini_cluster.cc:1428] Setting key adf43a7122709b732f089a22369cee84
Jun 18 23:23:33 dist-test-slave-r9ct krb5kdc[20910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825013, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:23:33.253767 20994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:33.245074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:41399 (local address 127.3.217.190:41667)
0618 23:23:33.245120 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:33.245122 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:33.245463 (+ 341us) server_negotiation.cc:407] Connection header received
0618 23:23:33.245907 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:33.245908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:33.245918 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:33.245970 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:33.246999 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.247536 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.248508 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.248795 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.248857 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:33.251373 (+ 2516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:33.251375 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:33.251375 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:33.251381 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:33.252622 (+ 1241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:33.253014 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:33.253015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:33.253015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:33.253063 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:33.253279 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:33.253280 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:33.253280 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:33.253376 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:33.253443 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:33.253650 (+ 207us) server_negotiation.cc:299] Negotiation successful
0618 23:23:33.253706 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260618 23:23:33.254004 21416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:33.245060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:41667 (local address 127.3.217.131:41399)
0618 23:23:33.245311 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:33.245358 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:33.245807 (+ 449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:33.246019 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:33.246022 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:33.246609 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:23:33.246885 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:33.246891 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.247619 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.247620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:33.248399 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:33.248401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.248874 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.248874 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:33.248984 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:33.249507 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:23:33.249515 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:23:33.251287 (+ 1772us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:23:33.252714 (+ 1427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:23:33.252721 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:23:33.252723 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:23:33.252950 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:23:33.253129 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:23:33.253130 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:23:33.253130 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:23:33.253226 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:23:33.253448 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:23:33.253452 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:23:33.253555 (+ 103us) client_negotiation.cc:769] Sending connection context
0618 23:23:33.253639 (+ 84us) client_negotiation.cc:240] Negotiation successful
0618 23:23:33.253749 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":139,"threads_started":1}
I20260618 23:23:33.254527 21414 heartbeater.cc:347] Connected to a master server at 127.3.217.190:41667
I20260618 23:23:33.254619 21414 heartbeater.cc:464] Registering TS with master...
I20260618 23:23:33.254823 21414 heartbeater.cc:511] Master 127.3.217.190:41667 requested a full tablet report, sending...
I20260618 23:23:33.255374 20955 ts_manager.cc:194] Registered new tserver with Master: 851105f11bbf46a1968efe7d1f27eaeb (127.3.217.131:37943)
I20260618 23:23:33.255990 20955 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:41399
I20260618 23:23:33.261485 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260618 23:23:33.269335 20994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:33.262931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53102 (local address 127.3.217.190:41667)
0618 23:23:33.262985 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:33.262987 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:33.263119 (+ 132us) server_negotiation.cc:407] Connection header received
0618 23:23:33.263168 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:33.263169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:33.263177 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:33.263263 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:33.263836 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.264471 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.265296 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.265474 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.265536 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:33.266910 (+ 1374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:33.266911 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:33.266911 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:33.266917 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:33.268298 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:33.268613 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:33.268614 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:33.268614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:33.268660 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:33.268844 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:33.268845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:33.268845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:33.268972 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:33.269050 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:33.269188 (+ 138us) server_negotiation.cc:299] Negotiation successful
0618 23:23:33.269273 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260618 23:23:33.271015 20955 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53102:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:23:33.272511 20955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:23:33.279526 21429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:33.275494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33730 (local address 127.3.217.131:37943)
0618 23:23:33.275679 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:33.275685 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:33.275695 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:23:33.275733 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:33.275735 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:33.275752 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:33.276015 (+ 263us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:33.276077 (+ 62us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.276869 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.278177 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.279005 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.279132 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:33.279199 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:33.279379 (+ 180us) server_negotiation.cc:299] Negotiation successful
0618 23:23:33.279423 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":94,"threads_started":1}
I20260618 23:23:33.279546 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:33.275221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:37943 (local address 127.0.0.1:33730)
0618 23:23:33.275380 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:33.275388 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:33.275441 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:33.275859 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:33.275862 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:33.275865 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:33.275941 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:33.275943 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.276968 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.276969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:33.278099 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:33.278101 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.279135 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.279136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:33.279236 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:33.279251 (+ 15us) client_negotiation.cc:769] Sending connection context
0618 23:23:33.279362 (+ 111us) client_negotiation.cc:240] Negotiation successful
0618 23:23:33.279423 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":80,"threads_started":1}
I20260618 23:23:33.279562 21427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:33.275263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:34299 (local address 127.0.0.1:49330)
0618 23:23:33.275674 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:33.275687 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:33.275760 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:33.275971 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:33.275972 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:33.275975 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:33.276025 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:33.276027 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.277525 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.277527 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:33.278449 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:33.278451 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.279312 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.279313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:33.279376 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:33.279381 (+ 5us) client_negotiation.cc:769] Sending connection context
0618 23:23:33.279429 (+ 48us) client_negotiation.cc:240] Negotiation successful
0618 23:23:33.279469 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":74,"threads_started":1}
I20260618 23:23:33.280076 21428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:33.275497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49330 (local address 127.3.217.129:34299)
0618 23:23:33.275680 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:33.275685 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:33.275746 (+ 61us) server_negotiation.cc:407] Connection header received
0618 23:23:33.275834 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:33.275836 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:33.275850 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:33.275911 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:33.276122 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.277414 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.278532 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.279156 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.279226 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:33.279278 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:33.279952 (+ 674us) server_negotiation.cc:299] Negotiation successful
0618 23:23:33.280002 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":86,"threads_started":1}
I20260618 23:23:33.280095 21425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:33.275214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:44395 (local address 127.0.0.1:55666)
0618 23:23:33.275333 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:33.275374 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:33.275441 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:33.276250 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:33.276252 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:33.276254 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:33.276296 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:33.276297 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.277627 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.277629 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:33.278939 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:33.278942 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.279845 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.279846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:33.279918 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:33.279923 (+ 5us) client_negotiation.cc:769] Sending connection context
0618 23:23:33.279988 (+ 65us) client_negotiation.cc:240] Negotiation successful
0618 23:23:33.280026 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":74,"threads_started":1}
I20260618 23:23:33.280128 21430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:33.275676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55666 (local address 127.3.217.130:44395)
0618 23:23:33.276087 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:33.276092 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:33.276102 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:23:33.276140 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:33.276142 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:33.276162 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:33.276238 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:33.276359 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.277508 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.279030 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.279757 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.279826 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:33.279876 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:33.280005 (+ 129us) server_negotiation.cc:299] Negotiation successful
0618 23:23:33.280046 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":140,"threads_started":1}
I20260618 23:23:33.280511 21348 tablet_service.cc:1467] Processing CreateTablet for tablet d5750263481f43aab64deb2c7af8e9d7 (DEFAULT_TABLE table=test-table [id=a7f3329ca1bb447b8cbb0f98cecc030c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:23:33.280786 21214 tablet_service.cc:1467] Processing CreateTablet for tablet d5750263481f43aab64deb2c7af8e9d7 (DEFAULT_TABLE table=test-table [id=a7f3329ca1bb447b8cbb0f98cecc030c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:23:33.280895 21348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5750263481f43aab64deb2c7af8e9d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:33.281097 21214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5750263481f43aab64deb2c7af8e9d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:33.281064 21080 tablet_service.cc:1467] Processing CreateTablet for tablet d5750263481f43aab64deb2c7af8e9d7 (DEFAULT_TABLE table=test-table [id=a7f3329ca1bb447b8cbb0f98cecc030c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:23:33.281399 21080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5750263481f43aab64deb2c7af8e9d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:33.283879 21431 tablet_bootstrap.cc:492] T d5750263481f43aab64deb2c7af8e9d7 P b3d7ccdc1ad64b6ba39f88681e3adf6a: Bootstrap starting.
I20260618 23:23:33.284567 21432 tablet_bootstrap.cc:492] T d5750263481f43aab64deb2c7af8e9d7 P 851105f11bbf46a1968efe7d1f27eaeb: Bootstrap starting.
I20260618 23:23:33.284595 21431 tablet_bootstrap.cc:654] T d5750263481f43aab64deb2c7af8e9d7 P b3d7ccdc1ad64b6ba39f88681e3adf6a: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:33.285197 21431 log.cc:824] T d5750263481f43aab64deb2c7af8e9d7 P b3d7ccdc1ad64b6ba39f88681e3adf6a: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:33.285256 21432 tablet_bootstrap.cc:654] T d5750263481f43aab64deb2c7af8e9d7 P 851105f11bbf46a1968efe7d1f27eaeb: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:33.285813 21432 log.cc:824] T d5750263481f43aab64deb2c7af8e9d7 P 851105f11bbf46a1968efe7d1f27eaeb: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:33.286072 21431 tablet_bootstrap.cc:492] T d5750263481f43aab64deb2c7af8e9d7 P b3d7ccdc1ad64b6ba39f88681e3adf6a: No bootstrap required, opened a new log
I20260618 23:23:33.286110 21433 tablet_bootstrap.cc:492] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81: Bootstrap starting.
I20260618 23:23:33.286170 21431 ts_tablet_manager.cc:1397] T d5750263481f43aab64deb2c7af8e9d7 P b3d7ccdc1ad64b6ba39f88681e3adf6a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:23:33.286651 21432 tablet_bootstrap.cc:492] T d5750263481f43aab64deb2c7af8e9d7 P 851105f11bbf46a1968efe7d1f27eaeb: No bootstrap required, opened a new log
I20260618 23:23:33.286653 21433 tablet_bootstrap.cc:654] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:33.286753 21432 ts_tablet_manager.cc:1397] T d5750263481f43aab64deb2c7af8e9d7 P 851105f11bbf46a1968efe7d1f27eaeb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:23:33.287230 21433 log.cc:824] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:33.287891 21433 tablet_bootstrap.cc:492] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81: No bootstrap required, opened a new log
I20260618 23:23:33.287957 21433 ts_tablet_manager.cc:1397] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:23:33.288128 21431 raft_consensus.cc:348] T d5750263481f43aab64deb2c7af8e9d7 P b3d7ccdc1ad64b6ba39f88681e3adf6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40442579c3554e90915767bfd17a3a81" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 44395 } } peers { permanent_uuid: "851105f11bbf46a1968efe7d1f27eaeb" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37943 } } peers { permanent_uuid: "b3d7ccdc1ad64b6ba39f88681e3adf6a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 34299 } }
I20260618 23:23:33.288259 21431 raft_consensus.cc:374] T d5750263481f43aab64deb2c7af8e9d7 P b3d7ccdc1ad64b6ba39f88681e3adf6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:33.288280 21431 raft_consensus.cc:729] T d5750263481f43aab64deb2c7af8e9d7 P b3d7ccdc1ad64b6ba39f88681e3adf6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3d7ccdc1ad64b6ba39f88681e3adf6a, State: Initialized, Role: FOLLOWER
I20260618 23:23:33.288389 21431 consensus_queue.cc:260] T d5750263481f43aab64deb2c7af8e9d7 P b3d7ccdc1ad64b6ba39f88681e3adf6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40442579c3554e90915767bfd17a3a81" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 44395 } } peers { permanent_uuid: "851105f11bbf46a1968efe7d1f27eaeb" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37943 } } peers { permanent_uuid: "b3d7ccdc1ad64b6ba39f88681e3adf6a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 34299 } }
I20260618 23:23:33.288658 21146 heartbeater.cc:503] Master 127.3.217.190:41667 was elected leader, sending a full tablet report...
I20260618 23:23:33.288656 21431 ts_tablet_manager.cc:1428] T d5750263481f43aab64deb2c7af8e9d7 P b3d7ccdc1ad64b6ba39f88681e3adf6a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:23:33.288800 21432 raft_consensus.cc:348] T d5750263481f43aab64deb2c7af8e9d7 P 851105f11bbf46a1968efe7d1f27eaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40442579c3554e90915767bfd17a3a81" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 44395 } } peers { permanent_uuid: "851105f11bbf46a1968efe7d1f27eaeb" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37943 } } peers { permanent_uuid: "b3d7ccdc1ad64b6ba39f88681e3adf6a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 34299 } }
I20260618 23:23:33.288947 21432 raft_consensus.cc:374] T d5750263481f43aab64deb2c7af8e9d7 P 851105f11bbf46a1968efe7d1f27eaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:33.288980 21432 raft_consensus.cc:729] T d5750263481f43aab64deb2c7af8e9d7 P 851105f11bbf46a1968efe7d1f27eaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 851105f11bbf46a1968efe7d1f27eaeb, State: Initialized, Role: FOLLOWER
I20260618 23:23:33.289078 21432 consensus_queue.cc:260] T d5750263481f43aab64deb2c7af8e9d7 P 851105f11bbf46a1968efe7d1f27eaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40442579c3554e90915767bfd17a3a81" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 44395 } } peers { permanent_uuid: "851105f11bbf46a1968efe7d1f27eaeb" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37943 } } peers { permanent_uuid: "b3d7ccdc1ad64b6ba39f88681e3adf6a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 34299 } }
I20260618 23:23:33.289320 21432 ts_tablet_manager.cc:1428] T d5750263481f43aab64deb2c7af8e9d7 P 851105f11bbf46a1968efe7d1f27eaeb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260618 23:23:33.289863 21433 raft_consensus.cc:348] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40442579c3554e90915767bfd17a3a81" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 44395 } } peers { permanent_uuid: "851105f11bbf46a1968efe7d1f27eaeb" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37943 } } peers { permanent_uuid: "b3d7ccdc1ad64b6ba39f88681e3adf6a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 34299 } }
I20260618 23:23:33.290004 21433 raft_consensus.cc:374] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:33.290045 21433 raft_consensus.cc:729] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40442579c3554e90915767bfd17a3a81, State: Initialized, Role: FOLLOWER
I20260618 23:23:33.290117 21433 consensus_queue.cc:260] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40442579c3554e90915767bfd17a3a81" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 44395 } } peers { permanent_uuid: "851105f11bbf46a1968efe7d1f27eaeb" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37943 } } peers { permanent_uuid: "b3d7ccdc1ad64b6ba39f88681e3adf6a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 34299 } }
I20260618 23:23:33.290315 21433 ts_tablet_manager.cc:1428] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:23:33.290402 21280 heartbeater.cc:503] Master 127.3.217.190:41667 was elected leader, sending a full tablet report...
I20260618 23:23:33.290421 21414 heartbeater.cc:503] Master 127.3.217.190:41667 was elected leader, sending a full tablet report...
W20260618 23:23:33.333541 21281 tablet.cc:2369] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260618 23:23:33.428748 21147 tablet.cc:2369] T d5750263481f43aab64deb2c7af8e9d7 P b3d7ccdc1ad64b6ba39f88681e3adf6a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260618 23:23:33.494899 21415 tablet.cc:2369] T d5750263481f43aab64deb2c7af8e9d7 P 851105f11bbf46a1968efe7d1f27eaeb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 23:23:33.580149 21439 raft_consensus.cc:482] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:23:33.580287 21439 raft_consensus.cc:504] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40442579c3554e90915767bfd17a3a81" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 44395 } } peers { permanent_uuid: "851105f11bbf46a1968efe7d1f27eaeb" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37943 } } peers { permanent_uuid: "b3d7ccdc1ad64b6ba39f88681e3adf6a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 34299 } }
I20260618 23:23:33.580753 21439 leader_election.cc:288] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 851105f11bbf46a1968efe7d1f27eaeb (127.3.217.131:37943), b3d7ccdc1ad64b6ba39f88681e3adf6a (127.3.217.129:34299)
I20260618 23:23:33.583556 21282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:33.580925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:37943 (local address 127.3.217.130:45885)
0618 23:23:33.580980 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:33.580992 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:33.581039 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:33.581217 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:33.581218 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:33.581220 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:33.581298 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:33.581300 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.581948 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.581949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:33.582678 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:33.582680 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.583292 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.583293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:33.583377 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:33.583380 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:23:33.583446 (+ 66us) client_negotiation.cc:240] Negotiation successful
0618 23:23:33.583487 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260618 23:23:33.583555 21429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:33.581050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:45885 (local address 127.3.217.131:37943)
0618 23:23:33.581093 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:33.581095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:33.581103 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:23:33.581129 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:33.581130 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:33.581140 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:33.581213 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:33.581372 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.581861 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.582828 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.583202 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.583295 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:33.583304 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:33.583452 (+ 148us) server_negotiation.cc:299] Negotiation successful
0618 23:23:33.583488 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260618 23:23:33.583873 21368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5750263481f43aab64deb2c7af8e9d7" candidate_uuid: "40442579c3554e90915767bfd17a3a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "851105f11bbf46a1968efe7d1f27eaeb" is_pre_election: true
I20260618 23:23:33.584017 21368 raft_consensus.cc:2454] T d5750263481f43aab64deb2c7af8e9d7 P 851105f11bbf46a1968efe7d1f27eaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40442579c3554e90915767bfd17a3a81 in term 0.
I20260618 23:23:33.584089 21428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:33.581051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:51289 (local address 127.3.217.129:34299)
0618 23:23:33.581101 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:33.581103 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:33.581207 (+ 104us) server_negotiation.cc:407] Connection header received
0618 23:23:33.581352 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:33.581353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:33.581362 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:33.581433 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:33.581615 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.582131 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.583279 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.583728 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.583802 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:33.583808 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:33.583988 (+ 180us) server_negotiation.cc:299] Negotiation successful
0618 23:23:33.584028 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260618 23:23:33.584095 21440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:33.580993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:34299 (local address 127.3.217.130:51289)
0618 23:23:33.581118 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:33.581130 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:33.581219 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:33.581436 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:33.581437 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:33.581439 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:33.581535 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:33.581537 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.582223 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.582224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:33.583183 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:33.583185 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.583839 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.583840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:33.583912 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:33.583915 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:23:33.583982 (+ 67us) client_negotiation.cc:240] Negotiation successful
0618 23:23:33.584018 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":62,"threads_started":1}
I20260618 23:23:33.584261 21170 leader_election.cc:302] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40442579c3554e90915767bfd17a3a81, 851105f11bbf46a1968efe7d1f27eaeb; no voters:
I20260618 23:23:33.584399 21439 raft_consensus.cc:2781] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:23:33.584420 21100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5750263481f43aab64deb2c7af8e9d7" candidate_uuid: "40442579c3554e90915767bfd17a3a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d7ccdc1ad64b6ba39f88681e3adf6a" is_pre_election: true
I20260618 23:23:33.584479 21439 raft_consensus.cc:482] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:23:33.584506 21439 raft_consensus.cc:3037] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:33.584544 21100 raft_consensus.cc:2454] T d5750263481f43aab64deb2c7af8e9d7 P b3d7ccdc1ad64b6ba39f88681e3adf6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40442579c3554e90915767bfd17a3a81 in term 0.
I20260618 23:23:33.585248 21439 raft_consensus.cc:504] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40442579c3554e90915767bfd17a3a81" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 44395 } } peers { permanent_uuid: "851105f11bbf46a1968efe7d1f27eaeb" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37943 } } peers { permanent_uuid: "b3d7ccdc1ad64b6ba39f88681e3adf6a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 34299 } }
I20260618 23:23:33.585395 21439 leader_election.cc:288] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81 [CANDIDATE]: Term 1 election: Requested vote from peers 851105f11bbf46a1968efe7d1f27eaeb (127.3.217.131:37943), b3d7ccdc1ad64b6ba39f88681e3adf6a (127.3.217.129:34299)
I20260618 23:23:33.585554 21368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5750263481f43aab64deb2c7af8e9d7" candidate_uuid: "40442579c3554e90915767bfd17a3a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "851105f11bbf46a1968efe7d1f27eaeb"
I20260618 23:23:33.585580 21100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5750263481f43aab64deb2c7af8e9d7" candidate_uuid: "40442579c3554e90915767bfd17a3a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d7ccdc1ad64b6ba39f88681e3adf6a"
I20260618 23:23:33.585621 21368 raft_consensus.cc:3037] T d5750263481f43aab64deb2c7af8e9d7 P 851105f11bbf46a1968efe7d1f27eaeb [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:33.585664 21100 raft_consensus.cc:3037] T d5750263481f43aab64deb2c7af8e9d7 P b3d7ccdc1ad64b6ba39f88681e3adf6a [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:33.586341 21100 raft_consensus.cc:2454] T d5750263481f43aab64deb2c7af8e9d7 P b3d7ccdc1ad64b6ba39f88681e3adf6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40442579c3554e90915767bfd17a3a81 in term 1.
I20260618 23:23:33.586385 21368 raft_consensus.cc:2454] T d5750263481f43aab64deb2c7af8e9d7 P 851105f11bbf46a1968efe7d1f27eaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40442579c3554e90915767bfd17a3a81 in term 1.
I20260618 23:23:33.586567 21168 leader_election.cc:302] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40442579c3554e90915767bfd17a3a81, b3d7ccdc1ad64b6ba39f88681e3adf6a; no voters:
I20260618 23:23:33.586679 21439 raft_consensus.cc:2781] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:33.586879 21439 raft_consensus.cc:686] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81 [term 1 LEADER]: Becoming Leader. State: Replica: 40442579c3554e90915767bfd17a3a81, State: Running, Role: LEADER
I20260618 23:23:33.586977 21439 consensus_queue.cc:237] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40442579c3554e90915767bfd17a3a81" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 44395 } } peers { permanent_uuid: "851105f11bbf46a1968efe7d1f27eaeb" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37943 } } peers { permanent_uuid: "b3d7ccdc1ad64b6ba39f88681e3adf6a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 34299 } }
I20260618 23:23:33.587771 20955 catalog_manager.cc:5495] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40442579c3554e90915767bfd17a3a81 (127.3.217.130). New cstate: current_term: 1 leader_uuid: "40442579c3554e90915767bfd17a3a81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40442579c3554e90915767bfd17a3a81" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 44395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "851105f11bbf46a1968efe7d1f27eaeb" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d7ccdc1ad64b6ba39f88681e3adf6a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 34299 } health_report { overall_health: UNKNOWN } } }
I20260618 23:23:33.636832 21430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:33.634445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55674 (local address 127.3.217.130:44395)
0618 23:23:33.634525 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:33.634527 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:33.634542 (+ 15us) server_negotiation.cc:407] Connection header received
0618 23:23:33.634576 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:33.634577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:33.634593 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:33.634654 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:23:33.634853 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.635309 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.636098 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.636294 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.636354 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:33.636493 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:23:33.636585 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:23:33.636642 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:33.636677 (+ 35us) server_negotiation.cc:299] Negotiation successful
0618 23:23:33.636694 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260618 23:23:33.638758 21100 raft_consensus.cc:1261] T d5750263481f43aab64deb2c7af8e9d7 P b3d7ccdc1ad64b6ba39f88681e3adf6a [term 1 FOLLOWER]: Refusing update from remote peer 40442579c3554e90915767bfd17a3a81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:23:33.638757 21368 raft_consensus.cc:1261] T d5750263481f43aab64deb2c7af8e9d7 P 851105f11bbf46a1968efe7d1f27eaeb [term 1 FOLLOWER]: Refusing update from remote peer 40442579c3554e90915767bfd17a3a81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:23:33.639130 21439 consensus_queue.cc:1035] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3d7ccdc1ad64b6ba39f88681e3adf6a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 34299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:23:33.639379 21441 consensus_queue.cc:1035] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "851105f11bbf46a1968efe7d1f27eaeb" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:23:33.641697 21444 mvcc.cc:205] Tried to move back new op lower bound from 7298355255861202944 to 7298355255652896768. Current Snapshot: MvccSnapshot[applied={T|T < 7298355255861202944}]
I20260618 23:23:33.642630 21445 mvcc.cc:205] Tried to move back new op lower bound from 7298355255861202944 to 7298355255652896768. Current Snapshot: MvccSnapshot[applied={T|T < 7298355255861202944}]
I20260618 23:23:33.643981 20955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:23:33.644096 20955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:23:33.644834 20955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0897375d99d04c2bb5237ad3d572e6c7: Sending DeleteTablet for 3 replicas of tablet d5750263481f43aab64deb2c7af8e9d7
I20260618 23:23:33.645160 21348 tablet_service.cc:1514] Processing DeleteTablet for tablet d5750263481f43aab64deb2c7af8e9d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:23:33 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:33730
I20260618 23:23:33.645267 21080 tablet_service.cc:1514] Processing DeleteTablet for tablet d5750263481f43aab64deb2c7af8e9d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:23:33 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:49330
I20260618 23:23:33.645402 21214 tablet_service.cc:1514] Processing DeleteTablet for tablet d5750263481f43aab64deb2c7af8e9d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:23:33 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:55666
I20260618 23:23:33.645471 21455 tablet_replica.cc:330] T d5750263481f43aab64deb2c7af8e9d7 P b3d7ccdc1ad64b6ba39f88681e3adf6a: stopping tablet replica
I20260618 23:23:33.645612 21455 raft_consensus.cc:2229] T d5750263481f43aab64deb2c7af8e9d7 P b3d7ccdc1ad64b6ba39f88681e3adf6a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:23:33.645783 21455 raft_consensus.cc:2258] T d5750263481f43aab64deb2c7af8e9d7 P b3d7ccdc1ad64b6ba39f88681e3adf6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:23:33.645831 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 21017
I20260618 23:23:33.647656 21456 tablet_replica.cc:330] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81: stopping tablet replica
I20260618 23:23:33.647778 21456 raft_consensus.cc:2229] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81 [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:23:33.647897 21456 raft_consensus.cc:2258] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:23:33.648043 21454 tablet_replica.cc:330] T d5750263481f43aab64deb2c7af8e9d7 P 851105f11bbf46a1968efe7d1f27eaeb: stopping tablet replica
I20260618 23:23:33.648175 21454 raft_consensus.cc:2229] T d5750263481f43aab64deb2c7af8e9d7 P 851105f11bbf46a1968efe7d1f27eaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:23:33.648334 21454 raft_consensus.cc:2258] T d5750263481f43aab64deb2c7af8e9d7 P 851105f11bbf46a1968efe7d1f27eaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:23:33.648342 21456 ts_tablet_manager.cc:1905] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:23:33.648809 21454 ts_tablet_manager.cc:1905] T d5750263481f43aab64deb2c7af8e9d7 P 851105f11bbf46a1968efe7d1f27eaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:23:33.650133 21456 ts_tablet_manager.cc:1918] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:23:33.650256 21456 log.cc:1196] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/d5750263481f43aab64deb2c7af8e9d7
I20260618 23:23:33.650561 21456 ts_tablet_manager.cc:1939] T d5750263481f43aab64deb2c7af8e9d7 P 40442579c3554e90915767bfd17a3a81: Deleting consensus metadata
I20260618 23:23:33.650594 21454 ts_tablet_manager.cc:1918] T d5750263481f43aab64deb2c7af8e9d7 P 851105f11bbf46a1968efe7d1f27eaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:23:33.650768 21454 log.cc:1196] T d5750263481f43aab64deb2c7af8e9d7 P 851105f11bbf46a1968efe7d1f27eaeb: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/d5750263481f43aab64deb2c7af8e9d7
I20260618 23:23:33.651026 20939 catalog_manager.cc:4841] TS 40442579c3554e90915767bfd17a3a81 (127.3.217.130:44395): tablet d5750263481f43aab64deb2c7af8e9d7 (table test-table [id=a7f3329ca1bb447b8cbb0f98cecc030c]) successfully deleted
I20260618 23:23:33.651858 21454 ts_tablet_manager.cc:1939] T d5750263481f43aab64deb2c7af8e9d7 P 851105f11bbf46a1968efe7d1f27eaeb: Deleting consensus metadata
W20260618 23:23:33.652798 20940 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.217.129:34299 (error 108)
I20260618 23:23:33.653429 21427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:33.653263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:34299 (local address 127.0.0.1:49338)
0618 23:23:33.653327 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:33.653392 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.129:34299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260618 23:23:33.653458 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 21151
I20260618 23:23:33.654109 20942 catalog_manager.cc:4841] TS 851105f11bbf46a1968efe7d1f27eaeb (127.3.217.131:37943): tablet d5750263481f43aab64deb2c7af8e9d7 (table test-table [id=a7f3329ca1bb447b8cbb0f98cecc030c]) successfully deleted
W20260618 23:23:33.654219 20940 catalog_manager.cc:4584] TS b3d7ccdc1ad64b6ba39f88681e3adf6a (127.3.217.129:34299): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d5750263481f43aab64deb2c7af8e9d7: Network error: Client connection negotiation failed: client connection to 127.3.217.129:34299: connect: Connection refused (error 111)
I20260618 23:23:33.658619 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 21285
I20260618 23:23:33.663885 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 20923
2026-06-18T23:23:33Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2331 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-06-18T23:23:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:23:33Z Disabled control of system clock
I20260618 23:23:33.691238 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:42409
--webserver_interface=127.3.217.190
--webserver_port=0
--builtin_ntp_servers=127.3.217.148:38147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:42409
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260618 23:23:33.772953 21461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:33.773178 21461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:33.773200 21461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:33.774364 21461 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:23:33.774416 21461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:33.774430 21461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:33.774443 21461 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:23:33.774456 21461 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:23:33.775903 21461 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:38147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:42409
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:42409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:33.776141 21461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:33.776453 21461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:33.781507 21466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:33.781517 21467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:33.781517 21469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:33.781889 21461 server_base.cc:1034] running on GCE node
I20260618 23:23:33.782102 21461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:33.782352 21461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:33.783495 21461 hybrid_clock.cc:648] HybridClock initialized: now 1781825013783450 us; error 60 us; skew 500 ppm
I20260618 23:23:33.784770 21461 webserver.cc:460] Webserver started at http://127.3.217.190:42699/ using document root <none> and password file <none>
I20260618 23:23:33.785009 21461 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:33.785053 21461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:33.785207 21461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:33.786319 21461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "4ad19a7df1fb4b3ea1a83dee39209cf7"
format_stamp: "Formatted at 2026-06-18 23:23:33 on dist-test-slave-r9ct"
server_key: "cf1621dd8057db626d70e829a478dd9d"
server_key_iv: "48b5b7c5b989c4b9c3705ccc0b76acd7"
server_key_version: "encryptionkey@0"
I20260618 23:23:33.786619 21461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "4ad19a7df1fb4b3ea1a83dee39209cf7"
format_stamp: "Formatted at 2026-06-18 23:23:33 on dist-test-slave-r9ct"
server_key: "cf1621dd8057db626d70e829a478dd9d"
server_key_iv: "48b5b7c5b989c4b9c3705ccc0b76acd7"
server_key_version: "encryptionkey@0"
I20260618 23:23:33.787915 21461 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:23:33.788681 21475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:33.788872 21461 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:23:33.788970 21461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "4ad19a7df1fb4b3ea1a83dee39209cf7"
format_stamp: "Formatted at 2026-06-18 23:23:33 on dist-test-slave-r9ct"
server_key: "cf1621dd8057db626d70e829a478dd9d"
server_key_iv: "48b5b7c5b989c4b9c3705ccc0b76acd7"
server_key_version: "encryptionkey@0"
I20260618 23:23:33.789053 21461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:33.816941 21461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:33.817276 21461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:33.817440 21461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:33.821585 21461 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:42409
I20260618 23:23:33.821626 21527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:42409 every 8 connection(s)
I20260618 23:23:33.821998 21461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:23:33.823025 21528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:33.825203 21528 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7: Bootstrap starting.
I20260618 23:23:33.825783 21528 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:33.825990 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 21461
I20260618 23:23:33.826128 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:23:33.826139 21528 log.cc:824] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:33.826371 3942 external_mini_cluster.cc:1428] Setting key e53c0bf7aa7df148475ac2038e52f7b7
I20260618 23:23:33.826982 21528 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7: No bootstrap required, opened a new log
I20260618 23:23:33.829505 21528 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ad19a7df1fb4b3ea1a83dee39209cf7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42409 } }
I20260618 23:23:33.829661 21528 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:33.829690 21528 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ad19a7df1fb4b3ea1a83dee39209cf7, State: Initialized, Role: FOLLOWER
I20260618 23:23:33.829813 21528 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ad19a7df1fb4b3ea1a83dee39209cf7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42409 } }
I20260618 23:23:33.829890 21528 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:23:33.829936 21528 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:23:33.829975 21528 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:33.830542 21528 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ad19a7df1fb4b3ea1a83dee39209cf7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42409 } }
I20260618 23:23:33.830653 21528 leader_election.cc:302] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ad19a7df1fb4b3ea1a83dee39209cf7; no voters:
I20260618 23:23:33.830842 21528 leader_election.cc:288] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:23:33.830883 21533 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:33.831013 21533 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7 [term 1 LEADER]: Becoming Leader. State: Replica: 4ad19a7df1fb4b3ea1a83dee39209cf7, State: Running, Role: LEADER
I20260618 23:23:33.831122 21528 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:23:33.831108 21533 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ad19a7df1fb4b3ea1a83dee39209cf7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42409 } }
I20260618 23:23:33.831568 21535 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ad19a7df1fb4b3ea1a83dee39209cf7. Latest consensus state: current_term: 1 leader_uuid: "4ad19a7df1fb4b3ea1a83dee39209cf7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ad19a7df1fb4b3ea1a83dee39209cf7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42409 } } }
I20260618 23:23:33.831651 21535 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:33.831884 21538 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:23:33.832533 21532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:33.826905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38558 (local address 127.3.217.190:42409)
0618 23:23:33.827090 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:33.827099 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:33.827129 (+ 30us) server_negotiation.cc:407] Connection header received
0618 23:23:33.827547 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:33.827553 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:33.827606 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:33.827714 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:33.827938 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.828784 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.829945 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.830389 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.830475 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:33.831463 (+ 988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:33.831467 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:33.831468 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:33.831681 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:33.831733 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:33.831750 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:33.831816 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:33.832188 (+ 372us) server_negotiation.cc:299] Negotiation successful
0618 23:23:33.832263 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":70,"threads_started":1}
I20260618 23:23:33.832880 21534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ad19a7df1fb4b3ea1a83dee39209cf7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ad19a7df1fb4b3ea1a83dee39209cf7" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42409 } } }
I20260618 23:23:33.833071 21534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:33.832358 21538 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:23:33.834491 21538 catalog_manager.cc:1347] Generated new cluster ID: e76bbf9e347c4678bb5e00cbab1a8ad3
I20260618 23:23:33.834570 21538 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:23:33.841559 21538 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:23:33.842125 21538 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:23:33.845333 21538 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7: Generated new TSK 0
I20260618 23:23:33.845709 21538 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:23:33.852947 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:42409
--builtin_ntp_servers=127.3.217.148:38147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260618 23:23:33.931676 21552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:33.931895 21552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:33.931919 21552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:33.933152 21552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:33.933194 21552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:33.933219 21552 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:23:33.934535 21552 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:38147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:42409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21552
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:33.934783 21552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:33.935061 21552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:33.940073 21558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:33.940106 21557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:33.940233 21552 server_base.cc:1034] running on GCE node
W20260618 23:23:33.940238 21560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:33.940652 21552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:33.940948 21552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:33.942135 21552 hybrid_clock.cc:648] HybridClock initialized: now 1781825013942122 us; error 26 us; skew 500 ppm
I20260618 23:23:33.943584 21552 webserver.cc:460] Webserver started at http://127.3.217.129:43401/ using document root <none> and password file <none>
I20260618 23:23:33.943866 21552 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:33.943943 21552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:33.944078 21552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:33.945559 21552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "622d8782949f45fba7e5e01a94d7ab54"
format_stamp: "Formatted at 2026-06-18 23:23:33 on dist-test-slave-r9ct"
server_key: "7db43720cac60f7b9dd1b8a153216bc2"
server_key_iv: "e69c28f2f162c52526b486ea4ec399e9"
server_key_version: "encryptionkey@0"
I20260618 23:23:33.945986 21552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "622d8782949f45fba7e5e01a94d7ab54"
format_stamp: "Formatted at 2026-06-18 23:23:33 on dist-test-slave-r9ct"
server_key: "7db43720cac60f7b9dd1b8a153216bc2"
server_key_iv: "e69c28f2f162c52526b486ea4ec399e9"
server_key_version: "encryptionkey@0"
I20260618 23:23:33.947741 21552 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260618 23:23:33.948735 21566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:33.948954 21552 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:33.949057 21552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "622d8782949f45fba7e5e01a94d7ab54"
format_stamp: "Formatted at 2026-06-18 23:23:33 on dist-test-slave-r9ct"
server_key: "7db43720cac60f7b9dd1b8a153216bc2"
server_key_iv: "e69c28f2f162c52526b486ea4ec399e9"
server_key_version: "encryptionkey@0"
I20260618 23:23:33.949139 21552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:33.965629 21552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:33.965961 21552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:33.966147 21552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:33.966375 21552 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:23:33.966691 21552 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:23:33.966781 21552 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:33.966835 21552 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:23:33.966861 21552 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:33.972797 21552 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:40861
I20260618 23:23:33.972883 21679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:40861 every 8 connection(s)
I20260618 23:23:33.973197 21552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:23:33.978117 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 21552
I20260618 23:23:33.978255 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:23:33.978506 3942 external_mini_cluster.cc:1428] Setting key 579e1d0ae0ec2551b7fb928b790b41e8
I20260618 23:23:33.979153 21532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:33.974012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:41319 (local address 127.3.217.190:42409)
0618 23:23:33.974078 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:33.974080 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:33.974294 (+ 214us) server_negotiation.cc:407] Connection header received
0618 23:23:33.974802 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:33.974804 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:33.974826 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:33.974886 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:33.975551 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.976296 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.977590 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.977811 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.977888 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:33.978853 (+ 965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:33.978854 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:33.978855 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:33.978859 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:33.978877 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:33.978883 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:33.978950 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:33.979042 (+ 92us) server_negotiation.cc:299] Negotiation successful
0618 23:23:33.979070 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260618 23:23:33.979393 21682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:33.973930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:42409 (local address 127.3.217.129:41319)
0618 23:23:33.974135 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:33.974174 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:33.974650 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:33.974952 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:33.974956 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:33.974964 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:23:33.975451 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:33.975455 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.976484 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.976486 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:33.977457 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:33.977459 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:33.977939 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:33.977940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:33.978048 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:33.978651 (+ 603us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:23:33.978652 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:23:33.978699 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:23:33.978756 (+ 57us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:23:33.978953 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:23:33.978961 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:23:33.978964 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:23:33.979046 (+ 82us) client_negotiation.cc:240] Negotiation successful
0618 23:23:33.979153 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":88,"threads_started":1}
I20260618 23:23:33.979699 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:42409
--builtin_ntp_servers=127.3.217.148:38147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260618 23:23:33.979910 21680 heartbeater.cc:347] Connected to a master server at 127.3.217.190:42409
I20260618 23:23:33.980011 21680 heartbeater.cc:464] Registering TS with master...
I20260618 23:23:33.980234 21680 heartbeater.cc:511] Master 127.3.217.190:42409 requested a full tablet report, sending...
I20260618 23:23:33.981132 21492 ts_manager.cc:194] Registered new tserver with Master: 622d8782949f45fba7e5e01a94d7ab54 (127.3.217.129:40861)
I20260618 23:23:33.982204 21492 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.217.129:41319
W20260618 23:23:34.061556 21683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:34.061755 21683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:34.061777 21683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:34.062846 21683 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:34.062882 21683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:34.062907 21683 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:23:34.064150 21683 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:38147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:42409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21683
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:34.064340 21683 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:34.064574 21683 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260618 23:23:34.070082 21683 server_base.cc:1034] running on GCE node
W20260618 23:23:34.070024 21688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:34.070041 21691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:34.070011 21689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:34.070536 21683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:34.070856 21683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:34.072028 21683 hybrid_clock.cc:648] HybridClock initialized: now 1781825014072006 us; error 51 us; skew 500 ppm
I20260618 23:23:34.073691 21683 webserver.cc:460] Webserver started at http://127.3.217.130:45167/ using document root <none> and password file <none>
I20260618 23:23:34.074047 21683 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:34.074149 21683 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:34.074312 21683 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:34.075524 21683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "0c884756e9b64733b3c629349647f78f"
format_stamp: "Formatted at 2026-06-18 23:23:34 on dist-test-slave-r9ct"
server_key: "0f723eccff72adae7d7ede81c8b4b90c"
server_key_iv: "4ee619ee935e78cc10b98a1f12b214b3"
server_key_version: "encryptionkey@0"
I20260618 23:23:34.076406 21683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "0c884756e9b64733b3c629349647f78f"
format_stamp: "Formatted at 2026-06-18 23:23:34 on dist-test-slave-r9ct"
server_key: "0f723eccff72adae7d7ede81c8b4b90c"
server_key_iv: "4ee619ee935e78cc10b98a1f12b214b3"
server_key_version: "encryptionkey@0"
I20260618 23:23:34.078390 21683 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260618 23:23:34.079339 21697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:34.079564 21683 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260618 23:23:34.079665 21683 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "0c884756e9b64733b3c629349647f78f"
format_stamp: "Formatted at 2026-06-18 23:23:34 on dist-test-slave-r9ct"
server_key: "0f723eccff72adae7d7ede81c8b4b90c"
server_key_iv: "4ee619ee935e78cc10b98a1f12b214b3"
server_key_version: "encryptionkey@0"
I20260618 23:23:34.079759 21683 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:34.091197 21683 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:34.091521 21683 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:34.091674 21683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:34.091903 21683 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:23:34.092235 21683 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:23:34.092298 21683 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:34.092341 21683 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:23:34.092372 21683 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:34.098567 21683 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:43749
I20260618 23:23:34.098613 21810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:43749 every 8 connection(s)
I20260618 23:23:34.098979 21683 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:23:34.104452 21532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:34.099703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:52987 (local address 127.3.217.190:42409)
0618 23:23:34.099757 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:34.099759 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:34.100032 (+ 273us) server_negotiation.cc:407] Connection header received
0618 23:23:34.100624 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:34.100624 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:34.100636 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:34.100681 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:34.101358 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.101867 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.102860 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.103047 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.103120 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:34.104120 (+ 1000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:34.104122 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:34.104122 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:34.104128 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:34.104150 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:34.104154 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:34.104231 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:34.104338 (+ 107us) server_negotiation.cc:299] Negotiation successful
0618 23:23:34.104366 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260618 23:23:34.104691 21813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:34.099654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:42409 (local address 127.3.217.130:52987)
0618 23:23:34.099888 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:34.099931 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:34.100518 (+ 587us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:34.100743 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:34.100748 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:34.100757 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:23:34.101247 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:34.101251 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.101960 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.101961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:34.102759 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:34.102761 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.103124 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.103125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:34.103258 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:34.103936 (+ 678us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:23:34.103937 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:23:34.103972 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:23:34.103996 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:23:34.104232 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:23:34.104239 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:23:34.104242 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:23:34.104339 (+ 97us) client_negotiation.cc:240] Negotiation successful
0618 23:23:34.104448 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":99,"threads_started":1}
I20260618 23:23:34.105311 21811 heartbeater.cc:347] Connected to a master server at 127.3.217.190:42409
I20260618 23:23:34.105396 21811 heartbeater.cc:464] Registering TS with master...
I20260618 23:23:34.105584 21811 heartbeater.cc:511] Master 127.3.217.190:42409 requested a full tablet report, sending...
I20260618 23:23:34.106042 21492 ts_manager.cc:194] Registered new tserver with Master: 0c884756e9b64733b3c629349647f78f (127.3.217.130:43749)
I20260618 23:23:34.106338 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 21683
I20260618 23:23:34.106454 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:23:34.106477 21492 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.217.130:52987
I20260618 23:23:34.106660 3942 external_mini_cluster.cc:1428] Setting key 255814e6d55887845754f4abe29e9326
I20260618 23:23:34.107582 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:42409
--builtin_ntp_servers=127.3.217.148:38147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260618 23:23:34.200870 21814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:34.201159 21814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:34.201187 21814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:34.203336 21814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:34.203410 21814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:34.203450 21814 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:23:34.204879 21814 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:38147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:42409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:34.205070 21814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:34.205328 21814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:34.210177 21819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:34.210180 21820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:34.210337 21814 server_base.cc:1034] running on GCE node
W20260618 23:23:34.210175 21822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:34.210589 21814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:34.210855 21814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:34.212028 21814 hybrid_clock.cc:648] HybridClock initialized: now 1781825014212024 us; error 38 us; skew 500 ppm
I20260618 23:23:34.213627 21814 webserver.cc:460] Webserver started at http://127.3.217.131:38285/ using document root <none> and password file <none>
I20260618 23:23:34.213925 21814 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:34.214000 21814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:34.214146 21814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:34.215305 21814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "dcbd9ffa63694c549579b632ecf72eba"
format_stamp: "Formatted at 2026-06-18 23:23:34 on dist-test-slave-r9ct"
server_key: "b794a513d05713524aa69fad1514f14c"
server_key_iv: "57ca1c371ea56762d83c4134b8062ba6"
server_key_version: "encryptionkey@0"
I20260618 23:23:34.215653 21814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "dcbd9ffa63694c549579b632ecf72eba"
format_stamp: "Formatted at 2026-06-18 23:23:34 on dist-test-slave-r9ct"
server_key: "b794a513d05713524aa69fad1514f14c"
server_key_iv: "57ca1c371ea56762d83c4134b8062ba6"
server_key_version: "encryptionkey@0"
I20260618 23:23:34.216989 21814 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260618 23:23:34.217880 21828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:34.218142 21814 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:34.218240 21814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "dcbd9ffa63694c549579b632ecf72eba"
format_stamp: "Formatted at 2026-06-18 23:23:34 on dist-test-slave-r9ct"
server_key: "b794a513d05713524aa69fad1514f14c"
server_key_iv: "57ca1c371ea56762d83c4134b8062ba6"
server_key_version: "encryptionkey@0"
I20260618 23:23:34.218338 21814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:34.237895 21814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:34.238233 21814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:34.238394 21814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:34.238644 21814 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:23:34.239012 21814 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:23:34.239073 21814 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:34.239120 21814 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:23:34.239147 21814 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:34.245391 21814 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:42017
I20260618 23:23:34.245443 21941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:42017 every 8 connection(s)
I20260618 23:23:34.245774 21814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:23:34.251919 21532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:34.246586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:53073 (local address 127.3.217.190:42409)
0618 23:23:34.246710 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:34.246713 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:34.246967 (+ 254us) server_negotiation.cc:407] Connection header received
0618 23:23:34.247542 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:34.247544 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:34.247555 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:34.247612 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:34.248330 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.248884 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.250248 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.250480 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.250647 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:34.251617 (+ 970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:34.251618 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:34.251618 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:34.251623 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:34.251636 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:34.251647 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:34.251710 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:34.251807 (+ 97us) server_negotiation.cc:299] Negotiation successful
0618 23:23:34.251840 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260618 23:23:34.252144 21944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:34.246495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:42409 (local address 127.3.217.131:53073)
0618 23:23:34.246839 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:34.246875 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:34.247429 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:34.247695 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:34.247700 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:34.247712 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:23:34.248235 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:34.248239 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.248995 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.248996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:34.250056 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:34.250063 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.250666 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.250667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:34.250858 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:34.251447 (+ 589us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:23:34.251447 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:23:34.251474 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:23:34.251496 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:23:34.251711 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:23:34.251716 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:23:34.251720 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:23:34.251809 (+ 89us) client_negotiation.cc:240] Negotiation successful
0618 23:23:34.251911 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":100,"threads_started":1}
I20260618 23:23:34.252638 21942 heartbeater.cc:347] Connected to a master server at 127.3.217.190:42409
I20260618 23:23:34.252781 21942 heartbeater.cc:464] Registering TS with master...
I20260618 23:23:34.252985 21942 heartbeater.cc:511] Master 127.3.217.190:42409 requested a full tablet report, sending...
I20260618 23:23:34.253490 21492 ts_manager.cc:194] Registered new tserver with Master: dcbd9ffa63694c549579b632ecf72eba (127.3.217.131:42017)
I20260618 23:23:34.253575 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 21814
I20260618 23:23:34.253682 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:23:34.253919 3942 external_mini_cluster.cc:1428] Setting key 9dbe8f39fa7d3978608cb5873f3edb66
I20260618 23:23:34.253968 21492 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.217.131:53073
I20260618 23:23:34.255195 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260618 23:23:34.260589 21532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:34.256948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55256 (local address 127.3.217.190:42409)
0618 23:23:34.257073 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:34.257075 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:34.257198 (+ 123us) server_negotiation.cc:407] Connection header received
0618 23:23:34.257247 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:34.257248 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:34.257260 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:34.257343 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:34.257547 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.258075 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.258953 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.259175 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.259273 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:34.260334 (+ 1061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:34.260335 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:34.260336 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:34.260340 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:34.260360 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:34.260364 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:34.260428 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:34.260484 (+ 56us) server_negotiation.cc:299] Negotiation successful
0618 23:23:34.260505 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260618 23:23:34.262234 21492 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55256:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:23:34.263898 21492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:23:34.270392 21952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:34.266201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:40861 (local address 127.0.0.1:49648)
0618 23:23:34.266635 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:34.266677 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:34.266778 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:34.267048 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:34.267050 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:34.267053 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:34.267150 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:34.267152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.268457 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.268458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:34.269238 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:34.269240 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.270101 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.270102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:34.270178 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:34.270189 (+ 11us) client_negotiation.cc:769] Sending connection context
0618 23:23:34.270259 (+ 70us) client_negotiation.cc:240] Negotiation successful
0618 23:23:34.270308 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"mutex_wait_us":7,"thread_start_us":54,"threads_started":1}
I20260618 23:23:34.270431 21954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:34.266444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49648 (local address 127.3.217.129:40861)
0618 23:23:34.266622 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:34.266627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:34.266763 (+ 136us) server_negotiation.cc:407] Connection header received
0618 23:23:34.266870 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:34.266872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:34.266889 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:34.266975 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:34.267244 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.268369 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.269332 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.269914 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.269983 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:34.270066 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:34.270297 (+ 231us) server_negotiation.cc:299] Negotiation successful
0618 23:23:34.270344 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":91,"threads_started":1}
I20260618 23:23:34.271214 21950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:34.266202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:43749 (local address 127.0.0.1:45714)
0618 23:23:34.266635 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:34.266677 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:34.266774 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:34.267047 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:34.267050 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:34.267055 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:34.267149 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:34.267152 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.268443 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.268444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:34.269932 (+ 1488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:34.269935 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.270961 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.270962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:34.271025 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:34.271029 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:23:34.271076 (+ 47us) client_negotiation.cc:240] Negotiation successful
0618 23:23:34.271124 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"mutex_wait_us":25,"thread_start_us":86,"threads_started":1}
I20260618 23:23:34.271121 21614 tablet_service.cc:1467] Processing CreateTablet for tablet 49535c7471cb476d8b5b08e45e55d3a4 (DEFAULT_TABLE table=test-table [id=f62da21cb0e74075989f59a3df058ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:23:34.271370 21953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:34.266441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45714 (local address 127.3.217.130:43749)
0618 23:23:34.266704 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:34.266766 (+ 62us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:34.266778 (+ 12us) server_negotiation.cc:407] Connection header received
0618 23:23:34.266880 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:34.266883 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:34.266897 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:34.266975 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:34.267234 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.268354 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.270026 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.270851 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.270957 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:34.271184 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:34.271212 (+ 28us) server_negotiation.cc:299] Negotiation successful
0618 23:23:34.271260 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":92,"threads_started":1}
I20260618 23:23:34.271483 21951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:34.266280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:42017 (local address 127.0.0.1:53808)
0618 23:23:34.266896 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:34.266906 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:34.266955 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:34.267220 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:34.267221 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:34.267223 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:34.267279 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:34.267280 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.268253 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.268254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:34.269683 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:34.269686 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.271065 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.271066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:34.271130 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:34.271135 (+ 5us) client_negotiation.cc:769] Sending connection context
0618 23:23:34.271185 (+ 50us) client_negotiation.cc:240] Negotiation successful
0618 23:23:34.271223 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"mutex_wait_us":47,"thread_start_us":114,"threads_started":1}
I20260618 23:23:34.271489 21614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49535c7471cb476d8b5b08e45e55d3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:34.271695 21955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:34.266536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53808 (local address 127.3.217.131:42017)
0618 23:23:34.266699 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:34.266703 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:34.267021 (+ 318us) server_negotiation.cc:407] Connection header received
0618 23:23:34.267066 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:34.267068 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:34.267086 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:34.267161 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:34.267368 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.268141 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.269775 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.270889 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.270954 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:34.271030 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:34.271579 (+ 549us) server_negotiation.cc:299] Negotiation successful
0618 23:23:34.271625 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":72,"threads_started":1}
I20260618 23:23:34.271914 21745 tablet_service.cc:1467] Processing CreateTablet for tablet 49535c7471cb476d8b5b08e45e55d3a4 (DEFAULT_TABLE table=test-table [id=f62da21cb0e74075989f59a3df058ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:23:34.272150 21745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49535c7471cb476d8b5b08e45e55d3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:34.273940 21956 tablet_bootstrap.cc:492] T 49535c7471cb476d8b5b08e45e55d3a4 P 622d8782949f45fba7e5e01a94d7ab54: Bootstrap starting.
I20260618 23:23:34.274621 21956 tablet_bootstrap.cc:654] T 49535c7471cb476d8b5b08e45e55d3a4 P 622d8782949f45fba7e5e01a94d7ab54: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:34.274610 21876 tablet_service.cc:1467] Processing CreateTablet for tablet 49535c7471cb476d8b5b08e45e55d3a4 (DEFAULT_TABLE table=test-table [id=f62da21cb0e74075989f59a3df058ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:23:34.274892 21957 tablet_bootstrap.cc:492] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f: Bootstrap starting.
I20260618 23:23:34.274974 21956 log.cc:824] T 49535c7471cb476d8b5b08e45e55d3a4 P 622d8782949f45fba7e5e01a94d7ab54: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:34.274996 21876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49535c7471cb476d8b5b08e45e55d3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:34.275485 21957 tablet_bootstrap.cc:654] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:34.275697 21956 tablet_bootstrap.cc:492] T 49535c7471cb476d8b5b08e45e55d3a4 P 622d8782949f45fba7e5e01a94d7ab54: No bootstrap required, opened a new log
I20260618 23:23:34.275769 21956 ts_tablet_manager.cc:1397] T 49535c7471cb476d8b5b08e45e55d3a4 P 622d8782949f45fba7e5e01a94d7ab54: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260618 23:23:34.275821 21957 log.cc:824] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:34.276633 21957 tablet_bootstrap.cc:492] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f: No bootstrap required, opened a new log
I20260618 23:23:34.276701 21957 ts_tablet_manager.cc:1397] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:23:34.277953 21960 tablet_bootstrap.cc:492] T 49535c7471cb476d8b5b08e45e55d3a4 P dcbd9ffa63694c549579b632ecf72eba: Bootstrap starting.
I20260618 23:23:34.278393 21956 raft_consensus.cc:348] T 49535c7471cb476d8b5b08e45e55d3a4 P 622d8782949f45fba7e5e01a94d7ab54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcbd9ffa63694c549579b632ecf72eba" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 42017 } } peers { permanent_uuid: "0c884756e9b64733b3c629349647f78f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43749 } } peers { permanent_uuid: "622d8782949f45fba7e5e01a94d7ab54" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 40861 } }
I20260618 23:23:34.278528 21960 tablet_bootstrap.cc:654] T 49535c7471cb476d8b5b08e45e55d3a4 P dcbd9ffa63694c549579b632ecf72eba: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:34.278563 21956 raft_consensus.cc:374] T 49535c7471cb476d8b5b08e45e55d3a4 P 622d8782949f45fba7e5e01a94d7ab54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:34.278599 21956 raft_consensus.cc:729] T 49535c7471cb476d8b5b08e45e55d3a4 P 622d8782949f45fba7e5e01a94d7ab54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 622d8782949f45fba7e5e01a94d7ab54, State: Initialized, Role: FOLLOWER
I20260618 23:23:34.278748 21956 consensus_queue.cc:260] T 49535c7471cb476d8b5b08e45e55d3a4 P 622d8782949f45fba7e5e01a94d7ab54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcbd9ffa63694c549579b632ecf72eba" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 42017 } } peers { permanent_uuid: "0c884756e9b64733b3c629349647f78f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43749 } } peers { permanent_uuid: "622d8782949f45fba7e5e01a94d7ab54" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 40861 } }
I20260618 23:23:34.278891 21960 log.cc:824] T 49535c7471cb476d8b5b08e45e55d3a4 P dcbd9ffa63694c549579b632ecf72eba: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:34.279006 21956 ts_tablet_manager.cc:1428] T 49535c7471cb476d8b5b08e45e55d3a4 P 622d8782949f45fba7e5e01a94d7ab54: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260618 23:23:34.279124 21680 heartbeater.cc:503] Master 127.3.217.190:42409 was elected leader, sending a full tablet report...
I20260618 23:23:34.279621 21960 tablet_bootstrap.cc:492] T 49535c7471cb476d8b5b08e45e55d3a4 P dcbd9ffa63694c549579b632ecf72eba: No bootstrap required, opened a new log
I20260618 23:23:34.279707 21960 ts_tablet_manager.cc:1397] T 49535c7471cb476d8b5b08e45e55d3a4 P dcbd9ffa63694c549579b632ecf72eba: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:23:34.279630 21957 raft_consensus.cc:348] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcbd9ffa63694c549579b632ecf72eba" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 42017 } } peers { permanent_uuid: "0c884756e9b64733b3c629349647f78f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43749 } } peers { permanent_uuid: "622d8782949f45fba7e5e01a94d7ab54" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 40861 } }
I20260618 23:23:34.279785 21957 raft_consensus.cc:374] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:34.279822 21957 raft_consensus.cc:729] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c884756e9b64733b3c629349647f78f, State: Initialized, Role: FOLLOWER
I20260618 23:23:34.279937 21957 consensus_queue.cc:260] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcbd9ffa63694c549579b632ecf72eba" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 42017 } } peers { permanent_uuid: "0c884756e9b64733b3c629349647f78f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43749 } } peers { permanent_uuid: "622d8782949f45fba7e5e01a94d7ab54" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 40861 } }
I20260618 23:23:34.280181 21957 ts_tablet_manager.cc:1428] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260618 23:23:34.280201 21811 heartbeater.cc:503] Master 127.3.217.190:42409 was elected leader, sending a full tablet report...
I20260618 23:23:34.282796 21960 raft_consensus.cc:348] T 49535c7471cb476d8b5b08e45e55d3a4 P dcbd9ffa63694c549579b632ecf72eba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcbd9ffa63694c549579b632ecf72eba" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 42017 } } peers { permanent_uuid: "0c884756e9b64733b3c629349647f78f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43749 } } peers { permanent_uuid: "622d8782949f45fba7e5e01a94d7ab54" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 40861 } }
I20260618 23:23:34.282967 21960 raft_consensus.cc:374] T 49535c7471cb476d8b5b08e45e55d3a4 P dcbd9ffa63694c549579b632ecf72eba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:34.283020 21960 raft_consensus.cc:729] T 49535c7471cb476d8b5b08e45e55d3a4 P dcbd9ffa63694c549579b632ecf72eba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcbd9ffa63694c549579b632ecf72eba, State: Initialized, Role: FOLLOWER
I20260618 23:23:34.283149 21960 consensus_queue.cc:260] T 49535c7471cb476d8b5b08e45e55d3a4 P dcbd9ffa63694c549579b632ecf72eba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcbd9ffa63694c549579b632ecf72eba" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 42017 } } peers { permanent_uuid: "0c884756e9b64733b3c629349647f78f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43749 } } peers { permanent_uuid: "622d8782949f45fba7e5e01a94d7ab54" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 40861 } }
I20260618 23:23:34.283439 21960 ts_tablet_manager.cc:1428] T 49535c7471cb476d8b5b08e45e55d3a4 P dcbd9ffa63694c549579b632ecf72eba: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260618 23:23:34.283625 21942 heartbeater.cc:503] Master 127.3.217.190:42409 was elected leader, sending a full tablet report...
W20260618 23:23:34.349684 21812 tablet.cc:2369] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 23:23:34.388913 21963 raft_consensus.cc:482] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:23:34.389096 21963 raft_consensus.cc:504] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcbd9ffa63694c549579b632ecf72eba" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 42017 } } peers { permanent_uuid: "0c884756e9b64733b3c629349647f78f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43749 } } peers { permanent_uuid: "622d8782949f45fba7e5e01a94d7ab54" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 40861 } }
I20260618 23:23:34.389707 21963 leader_election.cc:288] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcbd9ffa63694c549579b632ecf72eba (127.3.217.131:42017), 622d8782949f45fba7e5e01a94d7ab54 (127.3.217.129:40861)
I20260618 23:23:34.393532 21813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:34.389838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:42017 (local address 127.3.217.130:49973)
0618 23:23:34.389884 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:34.389903 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:34.389961 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:34.390186 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:34.390188 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:34.390189 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:34.390269 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:34.390271 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.391218 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.391219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:34.392486 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:34.392489 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.393232 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.393233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:34.393369 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:34.393373 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:23:34.393429 (+ 56us) client_negotiation.cc:240] Negotiation successful
0618 23:23:34.393462 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25,"mutex_wait_us":6}
I20260618 23:23:34.393572 21955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:34.389898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:49973 (local address 127.3.217.131:42017)
0618 23:23:34.389947 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:34.389949 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:34.389961 (+ 12us) server_negotiation.cc:407] Connection header received
0618 23:23:34.390100 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:34.390101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:34.390108 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:34.390161 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:34.390334 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.391119 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.392577 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.393126 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.393204 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:34.393212 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:34.393447 (+ 235us) server_negotiation.cc:299] Negotiation successful
0618 23:23:34.393490 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260618 23:23:34.393572 21954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:34.390035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:44361 (local address 127.3.217.129:40861)
0618 23:23:34.390110 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:34.390112 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:34.390268 (+ 156us) server_negotiation.cc:407] Connection header received
0618 23:23:34.390311 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:34.390312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:34.390326 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:34.390377 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:34.390518 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.391202 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.392577 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.393122 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.393204 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:34.393212 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:34.393456 (+ 244us) server_negotiation.cc:299] Negotiation successful
0618 23:23:34.393494 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260618 23:23:34.393538 21965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:34.389908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:40861 (local address 127.3.217.130:44361)
0618 23:23:34.390114 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:34.390125 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:34.390186 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:34.390395 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:34.390396 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:34.390397 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:34.390447 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:34.390448 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.391293 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.391294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:34.392491 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:34.392492 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.393232 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.393233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:34.393323 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:34.393329 (+ 6us) client_negotiation.cc:769] Sending connection context
0618 23:23:34.393396 (+ 67us) client_negotiation.cc:240] Negotiation successful
0618 23:23:34.393445 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":28,"thread_start_us":118,"threads_started":1}
I20260618 23:23:34.393955 21634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49535c7471cb476d8b5b08e45e55d3a4" candidate_uuid: "0c884756e9b64733b3c629349647f78f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622d8782949f45fba7e5e01a94d7ab54" is_pre_election: true
I20260618 23:23:34.394124 21634 raft_consensus.cc:2454] T 49535c7471cb476d8b5b08e45e55d3a4 P 622d8782949f45fba7e5e01a94d7ab54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c884756e9b64733b3c629349647f78f in term 0.
I20260618 23:23:34.394078 21896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49535c7471cb476d8b5b08e45e55d3a4" candidate_uuid: "0c884756e9b64733b3c629349647f78f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcbd9ffa63694c549579b632ecf72eba" is_pre_election: true
I20260618 23:23:34.394239 21896 raft_consensus.cc:2454] T 49535c7471cb476d8b5b08e45e55d3a4 P dcbd9ffa63694c549579b632ecf72eba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c884756e9b64733b3c629349647f78f in term 0.
I20260618 23:23:34.394392 21701 leader_election.cc:302] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c884756e9b64733b3c629349647f78f, 622d8782949f45fba7e5e01a94d7ab54; no voters:
I20260618 23:23:34.394541 21963 raft_consensus.cc:2781] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:23:34.394603 21963 raft_consensus.cc:482] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:23:34.394619 21963 raft_consensus.cc:3037] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:34.395372 21963 raft_consensus.cc:504] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcbd9ffa63694c549579b632ecf72eba" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 42017 } } peers { permanent_uuid: "0c884756e9b64733b3c629349647f78f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43749 } } peers { permanent_uuid: "622d8782949f45fba7e5e01a94d7ab54" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 40861 } }
I20260618 23:23:34.395519 21963 leader_election.cc:288] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f [CANDIDATE]: Term 1 election: Requested vote from peers dcbd9ffa63694c549579b632ecf72eba (127.3.217.131:42017), 622d8782949f45fba7e5e01a94d7ab54 (127.3.217.129:40861)
I20260618 23:23:34.395663 21896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49535c7471cb476d8b5b08e45e55d3a4" candidate_uuid: "0c884756e9b64733b3c629349647f78f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcbd9ffa63694c549579b632ecf72eba"
I20260618 23:23:34.395740 21896 raft_consensus.cc:3037] T 49535c7471cb476d8b5b08e45e55d3a4 P dcbd9ffa63694c549579b632ecf72eba [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:34.396467 21896 raft_consensus.cc:2454] T 49535c7471cb476d8b5b08e45e55d3a4 P dcbd9ffa63694c549579b632ecf72eba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c884756e9b64733b3c629349647f78f in term 1.
I20260618 23:23:34.396651 21698 leader_election.cc:302] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c884756e9b64733b3c629349647f78f, dcbd9ffa63694c549579b632ecf72eba; no voters:
I20260618 23:23:34.396646 21634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49535c7471cb476d8b5b08e45e55d3a4" candidate_uuid: "0c884756e9b64733b3c629349647f78f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "622d8782949f45fba7e5e01a94d7ab54"
I20260618 23:23:34.396756 21963 raft_consensus.cc:2781] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:34.396751 21634 raft_consensus.cc:3037] T 49535c7471cb476d8b5b08e45e55d3a4 P 622d8782949f45fba7e5e01a94d7ab54 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:34.396917 21963 raft_consensus.cc:686] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f [term 1 LEADER]: Becoming Leader. State: Replica: 0c884756e9b64733b3c629349647f78f, State: Running, Role: LEADER
I20260618 23:23:34.397023 21963 consensus_queue.cc:237] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcbd9ffa63694c549579b632ecf72eba" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 42017 } } peers { permanent_uuid: "0c884756e9b64733b3c629349647f78f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43749 } } peers { permanent_uuid: "622d8782949f45fba7e5e01a94d7ab54" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 40861 } }
I20260618 23:23:34.397642 21634 raft_consensus.cc:2454] T 49535c7471cb476d8b5b08e45e55d3a4 P 622d8782949f45fba7e5e01a94d7ab54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c884756e9b64733b3c629349647f78f in term 1.
I20260618 23:23:34.397888 21491 catalog_manager.cc:5495] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c884756e9b64733b3c629349647f78f (127.3.217.130). New cstate: current_term: 1 leader_uuid: "0c884756e9b64733b3c629349647f78f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dcbd9ffa63694c549579b632ecf72eba" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c884756e9b64733b3c629349647f78f" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "622d8782949f45fba7e5e01a94d7ab54" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 40861 } health_report { overall_health: UNKNOWN } } }
I20260618 23:23:34.419559 21953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:34.416963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45730 (local address 127.3.217.130:43749)
0618 23:23:34.417030 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:34.417032 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:34.417039 (+ 7us) server_negotiation.cc:407] Connection header received
0618 23:23:34.417071 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:34.417071 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:34.417089 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:34.417151 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:23:34.417330 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.417806 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.418642 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:34.418908 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:34.418965 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:34.419153 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:23:34.419246 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:23:34.419367 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:34.419406 (+ 39us) server_negotiation.cc:299] Negotiation successful
0618 23:23:34.419424 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260618 23:23:34.421876 21896 raft_consensus.cc:1261] T 49535c7471cb476d8b5b08e45e55d3a4 P dcbd9ffa63694c549579b632ecf72eba [term 1 FOLLOWER]: Refusing update from remote peer 0c884756e9b64733b3c629349647f78f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:23:34.421913 21634 raft_consensus.cc:1261] T 49535c7471cb476d8b5b08e45e55d3a4 P 622d8782949f45fba7e5e01a94d7ab54 [term 1 FOLLOWER]: Refusing update from remote peer 0c884756e9b64733b3c629349647f78f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:23:34.422309 21963 consensus_queue.cc:1035] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcbd9ffa63694c549579b632ecf72eba" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:23:34.422480 21966 consensus_queue.cc:1035] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f [LEADER]: Connected to new peer: Peer: permanent_uuid: "622d8782949f45fba7e5e01a94d7ab54" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 40861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:23:34.424705 21969 mvcc.cc:205] Tried to move back new op lower bound from 7298355259068387328 to 7298355258970869760. Current Snapshot: MvccSnapshot[applied={T|T < 7298355259068387328}]
I20260618 23:23:34.424957 21970 mvcc.cc:205] Tried to move back new op lower bound from 7298355259068387328 to 7298355258970869760. Current Snapshot: MvccSnapshot[applied={T|T < 7298355259068387328}]
I20260618 23:23:34.427201 21492 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:23:34.427304 21492 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:23:34.428045 21492 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4ad19a7df1fb4b3ea1a83dee39209cf7: Sending DeleteTablet for 3 replicas of tablet 49535c7471cb476d8b5b08e45e55d3a4
I20260618 23:23:34.428438 21614 tablet_service.cc:1514] Processing DeleteTablet for tablet 49535c7471cb476d8b5b08e45e55d3a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:23:34 UTC) from {username='slave'} at 127.0.0.1:49648
I20260618 23:23:34.428831 21876 tablet_service.cc:1514] Processing DeleteTablet for tablet 49535c7471cb476d8b5b08e45e55d3a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:23:34 UTC) from {username='slave'} at 127.0.0.1:53808
I20260618 23:23:34.429095 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 21552
I20260618 23:23:34.429137 21980 tablet_replica.cc:330] T 49535c7471cb476d8b5b08e45e55d3a4 P dcbd9ffa63694c549579b632ecf72eba: stopping tablet replica
I20260618 23:23:34.429124 21745 tablet_service.cc:1514] Processing DeleteTablet for tablet 49535c7471cb476d8b5b08e45e55d3a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:23:34 UTC) from {username='slave'} at 127.0.0.1:45714
I20260618 23:23:34.429242 21980 raft_consensus.cc:2229] T 49535c7471cb476d8b5b08e45e55d3a4 P dcbd9ffa63694c549579b632ecf72eba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:23:34.429781 21980 raft_consensus.cc:2258] T 49535c7471cb476d8b5b08e45e55d3a4 P dcbd9ffa63694c549579b632ecf72eba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:23:34.430197 21980 ts_tablet_manager.cc:1905] T 49535c7471cb476d8b5b08e45e55d3a4 P dcbd9ffa63694c549579b632ecf72eba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:23:34.431850 21980 ts_tablet_manager.cc:1918] T 49535c7471cb476d8b5b08e45e55d3a4 P dcbd9ffa63694c549579b632ecf72eba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:23:34.431901 21980 log.cc:1196] T 49535c7471cb476d8b5b08e45e55d3a4 P dcbd9ffa63694c549579b632ecf72eba: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/49535c7471cb476d8b5b08e45e55d3a4
I20260618 23:23:34.432199 21980 ts_tablet_manager.cc:1939] T 49535c7471cb476d8b5b08e45e55d3a4 P dcbd9ffa63694c549579b632ecf72eba: Deleting consensus metadata
I20260618 23:23:34.432547 21476 catalog_manager.cc:4841] TS dcbd9ffa63694c549579b632ecf72eba (127.3.217.131:42017): tablet 49535c7471cb476d8b5b08e45e55d3a4 (table test-table [id=f62da21cb0e74075989f59a3df058ba5]) successfully deleted
I20260618 23:23:34.435729 21981 tablet_replica.cc:330] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f: stopping tablet replica
I20260618 23:23:34.435923 21981 raft_consensus.cc:2229] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:23:34.436178 21981 raft_consensus.cc:2258] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260618 23:23:34.436363 21479 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.217.129:40861 (error 108)
I20260618 23:23:34.436870 21951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:34.436745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:40861 (local address 127.0.0.1:49652)
0618 23:23:34.436799 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:34.436836 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.129:40861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260618 23:23:34.436990 21479 catalog_manager.cc:4584] TS 622d8782949f45fba7e5e01a94d7ab54 (127.3.217.129:40861): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 49535c7471cb476d8b5b08e45e55d3a4: Network error: Client connection negotiation failed: client connection to 127.3.217.129:40861: connect: Connection refused (error 111)
I20260618 23:23:34.437093 21981 ts_tablet_manager.cc:1905] T 49535c7471cb476d8b5b08e45e55d3a4 P 0c884756e9b64733b3c629349647f78f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:23:34.437352 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 21683
I20260618 23:23:34.442829 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 21814
I20260618 23:23:34.442873 21951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:34.442744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:43749 (local address 127.0.0.1:45740)
0618 23:23:34.442793 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:34.442823 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.130:43749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260618 23:23:34.448006 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 21461
2026-06-18T23:23:34Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (784 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:23:34 dist-test-slave-r9ct krb5kdc[21985](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:23:34 dist-test-slave-r9ct krb5kdc[21985](info): set up 2 sockets
Jun 18 23:23:34 dist-test-slave-r9ct krb5kdc[21985](info): commencing operation
krb5kdc: starting...
W20260618 23:23:35.507534 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.039s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:23:35 dist-test-slave-r9ct krb5kdc[21985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:23:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:23:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:23:35.634780 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:37691
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:37691
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:35.715528 21998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:35.715734 21998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:35.715755 21998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:35.716814 21998 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:23:35.716859 21998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:35.716873 21998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:35.716885 21998 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:23:35.716897 21998 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:23:35.718252 21998 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:37691
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:37691
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:35.718439 21998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:35.718662 21998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:35.723516 22006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:35.723526 22003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:35.723534 22004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:35.723858 21998 server_base.cc:1034] running on GCE node
I20260618 23:23:35.724079 21998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:35.724387 21998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:35.725555 21998 hybrid_clock.cc:648] HybridClock initialized: now 1781825015725545 us; error 30 us; skew 500 ppm
Jun 18 23:23:35 dist-test-slave-r9ct krb5kdc[21985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825015, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:35.733148 21998 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:23:35.733656 21998 webserver.cc:460] Webserver started at http://127.3.217.190:37445/ using document root <none> and password file <none>
I20260618 23:23:35.733907 21998 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:35.733958 21998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:35.734082 21998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:35.735204 21998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "ceaf94dad5cf491ab29d153499e16e79"
format_stamp: "Formatted at 2026-06-18 23:23:35 on dist-test-slave-r9ct"
server_key: "ee293f4b0efe7edafad725a3e08d5614"
server_key_iv: "cea5df4f2a4a077363e6653bb26bd2ad"
server_key_version: "encryptionkey@0"
I20260618 23:23:35.735600 21998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "ceaf94dad5cf491ab29d153499e16e79"
format_stamp: "Formatted at 2026-06-18 23:23:35 on dist-test-slave-r9ct"
server_key: "ee293f4b0efe7edafad725a3e08d5614"
server_key_iv: "cea5df4f2a4a077363e6653bb26bd2ad"
server_key_version: "encryptionkey@0"
I20260618 23:23:35.736970 21998 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260618 23:23:35.737919 22013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:35.738179 21998 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:35.738306 21998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "ceaf94dad5cf491ab29d153499e16e79"
format_stamp: "Formatted at 2026-06-18 23:23:35 on dist-test-slave-r9ct"
server_key: "ee293f4b0efe7edafad725a3e08d5614"
server_key_iv: "cea5df4f2a4a077363e6653bb26bd2ad"
server_key_version: "encryptionkey@0"
I20260618 23:23:35.738435 21998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:35.750883 21998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:35.753208 21998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:35.753410 21998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:35.759382 21998 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:37691
I20260618 23:23:35.759439 22065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:37691 every 8 connection(s)
I20260618 23:23:35.759886 21998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:23:35.760846 22066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:35.763573 22066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79: Bootstrap starting.
I20260618 23:23:35.764092 22066 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:35.764330 22066 log.cc:824] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:35.765002 22066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79: No bootstrap required, opened a new log
I20260618 23:23:35.766584 22066 raft_consensus.cc:348] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceaf94dad5cf491ab29d153499e16e79" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37691 } }
I20260618 23:23:35.766773 22066 raft_consensus.cc:374] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:35.766824 22066 raft_consensus.cc:729] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceaf94dad5cf491ab29d153499e16e79, State: Initialized, Role: FOLLOWER
I20260618 23:23:35.766950 22066 consensus_queue.cc:260] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceaf94dad5cf491ab29d153499e16e79" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37691 } }
I20260618 23:23:35.767032 22066 raft_consensus.cc:388] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:23:35.767055 22066 raft_consensus.cc:482] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:23:35.767082 22066 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:35.767555 22066 raft_consensus.cc:504] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceaf94dad5cf491ab29d153499e16e79" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37691 } }
I20260618 23:23:35.767633 22066 leader_election.cc:302] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ceaf94dad5cf491ab29d153499e16e79; no voters:
I20260618 23:23:35.767755 22066 leader_election.cc:288] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:23:35.767885 22069 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:35.768020 22066 sys_catalog.cc:564] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:23:35.768093 22069 raft_consensus.cc:686] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79 [term 1 LEADER]: Becoming Leader. State: Replica: ceaf94dad5cf491ab29d153499e16e79, State: Running, Role: LEADER
I20260618 23:23:35.768187 22069 consensus_queue.cc:237] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceaf94dad5cf491ab29d153499e16e79" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37691 } }
I20260618 23:23:35.768923 22070 sys_catalog.cc:455] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ceaf94dad5cf491ab29d153499e16e79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceaf94dad5cf491ab29d153499e16e79" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37691 } } }
I20260618 23:23:35.769003 22070 sys_catalog.cc:458] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:35.768895 22071 sys_catalog.cc:455] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ceaf94dad5cf491ab29d153499e16e79. Latest consensus state: current_term: 1 leader_uuid: "ceaf94dad5cf491ab29d153499e16e79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceaf94dad5cf491ab29d153499e16e79" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37691 } } }
I20260618 23:23:35.769227 22071 sys_catalog.cc:458] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:35.769537 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 21998
I20260618 23:23:35.769686 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:23:35.769905 3942 external_mini_cluster.cc:1428] Setting key c403156124d454f0d0fd0f89caa77c3e
I20260618 23:23:35.769224 22079 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:23:35.770283 22079 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:23:35.772924 22079 catalog_manager.cc:1347] Generated new cluster ID: 88f0191cfb8e4273be1f4b2b4c094d0b
I20260618 23:23:35.772977 22079 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 18 23:23:35 dist-test-slave-r9ct krb5kdc[21985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:23:35.781195 22088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:35.770569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36832 (local address 127.3.217.190:37691)
0618 23:23:35.770756 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:35.770765 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:35.770800 (+ 35us) server_negotiation.cc:407] Connection header received
0618 23:23:35.770931 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:35.770938 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:35.771002 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:35.771154 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:35.771874 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:35.772769 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:35.773857 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:35.774499 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:35.774618 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:35.777530 (+ 2912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:35.777534 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:35.777535 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:35.777546 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:35.779576 (+ 2030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:35.779991 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:35.779994 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:35.779994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:35.780093 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:35.780298 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:35.780299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:35.780299 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:35.780578 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:35.780728 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:35.780835 (+ 107us) server_negotiation.cc:299] Negotiation successful
0618 23:23:35.780964 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":73,"threads_started":1}
I20260618 23:23:35.789515 22079 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:23:35.790465 22079 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:23:35.799142 22079 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79: Generated new TSK 0
I20260618 23:23:35.799342 22079 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.217.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
I20260618 23:23:35.830502 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:37691
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:35.914811 22092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:35.915005 22092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:35.915032 22092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:35.916244 22092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:35.916292 22092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:35.916322 22092 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:23:35.918020 22092 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:37691
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:35.918351 22092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:35.918634 22092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:35.924230 22100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:35.924268 22098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:35.924398 22092 server_base.cc:1034] running on GCE node
W20260618 23:23:35.924520 22097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:35.924749 22092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:35.925000 22092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:35.926174 22092 hybrid_clock.cc:648] HybridClock initialized: now 1781825015926167 us; error 27 us; skew 500 ppm
Jun 18 23:23:35 dist-test-slave-r9ct krb5kdc[21985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825015, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:35.929454 22092 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:23:35.929828 22092 webserver.cc:460] Webserver started at http://127.3.217.129:45849/ using document root <none> and password file <none>
I20260618 23:23:35.930085 22092 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:35.930157 22092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:35.930313 22092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:35.931394 22092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "899296a8d8794a24b451becd3d52260a"
format_stamp: "Formatted at 2026-06-18 23:23:35 on dist-test-slave-r9ct"
server_key: "5eb3482af233a69b4b2c7620c4805c0d"
server_key_iv: "6349f9ecff4e8d900d584fffa9d46166"
server_key_version: "encryptionkey@0"
I20260618 23:23:35.931735 22092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "899296a8d8794a24b451becd3d52260a"
format_stamp: "Formatted at 2026-06-18 23:23:35 on dist-test-slave-r9ct"
server_key: "5eb3482af233a69b4b2c7620c4805c0d"
server_key_iv: "6349f9ecff4e8d900d584fffa9d46166"
server_key_version: "encryptionkey@0"
I20260618 23:23:35.933187 22092 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260618 23:23:35.934012 22107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:35.934343 22092 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:23:35.934468 22092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "899296a8d8794a24b451becd3d52260a"
format_stamp: "Formatted at 2026-06-18 23:23:35 on dist-test-slave-r9ct"
server_key: "5eb3482af233a69b4b2c7620c4805c0d"
server_key_iv: "6349f9ecff4e8d900d584fffa9d46166"
server_key_version: "encryptionkey@0"
I20260618 23:23:35.934543 22092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:35.961347 22092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:35.963781 22092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:35.963951 22092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:35.964201 22092 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:23:35.964525 22092 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:23:35.964581 22092 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:35.964622 22092 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:23:35.964650 22092 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:35.971060 22092 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:41831
I20260618 23:23:35.971117 22220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:41831 every 8 connection(s)
I20260618 23:23:35.971460 22092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:23:35.975855 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 22092
I20260618 23:23:35.975994 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:23:35.976192 3942 external_mini_cluster.cc:1428] Setting key 74996200d8198cb161065c0aeeaa7627
Jun 18 23:23:35 dist-test-slave-r9ct krb5kdc[21985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825015, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:23:35.981887 22088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:35.972391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:59913 (local address 127.3.217.190:37691)
0618 23:23:35.972457 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:35.972459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:35.972589 (+ 130us) server_negotiation.cc:407] Connection header received
0618 23:23:35.973052 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:35.973053 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:35.973065 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:35.973127 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:35.974057 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:35.974821 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:35.975856 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:35.976146 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:35.976209 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:35.978517 (+ 2308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:35.978519 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:35.978519 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:35.978528 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:35.980315 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:35.980862 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:35.980862 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:35.980863 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:35.980914 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:35.981194 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:35.981195 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:35.981195 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:35.981299 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:35.981373 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:35.981736 (+ 363us) server_negotiation.cc:299] Negotiation successful
0618 23:23:35.981812 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260618 23:23:35.982147 22223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:35.972265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37691 (local address 127.3.217.129:59913)
0618 23:23:35.972417 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:35.972459 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:35.972964 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:35.973177 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:35.973180 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:35.973745 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:23:35.973932 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:35.973936 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:35.974923 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:35.974924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:35.975749 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:35.975752 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:35.976321 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:35.976322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:35.976531 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:35.977095 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:23:35.977104 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:23:35.978417 (+ 1313us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:23:35.980439 (+ 2022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:23:35.980446 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:23:35.980449 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:23:35.980773 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:23:35.980985 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:23:35.980986 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:23:35.980986 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:23:35.981124 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:23:35.981387 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:23:35.981394 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:23:35.981562 (+ 168us) client_negotiation.cc:769] Sending connection context
0618 23:23:35.981690 (+ 128us) client_negotiation.cc:240] Negotiation successful
0618 23:23:35.981871 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":89,"threads_started":1}
I20260618 23:23:35.982746 22221 heartbeater.cc:347] Connected to a master server at 127.3.217.190:37691
I20260618 23:23:35.982862 22221 heartbeater.cc:464] Registering TS with master...
I20260618 23:23:35.983048 22221 heartbeater.cc:511] Master 127.3.217.190:37691 requested a full tablet report, sending...
I20260618 23:23:35.983633 22030 ts_manager.cc:194] Registered new tserver with Master: 899296a8d8794a24b451becd3d52260a (127.3.217.129:41831)
I20260618 23:23:35.984265 22030 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:59913
WARNING: no policy specified for kudu/127.3.217.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
I20260618 23:23:36.004231 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:37691
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:36.088827 22226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:36.089049 22226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:36.089089 22226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:36.090276 22226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:36.090345 22226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:36.090391 22226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:23:36.091843 22226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:37691
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:36.092099 22226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:36.092320 22226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:36.097586 22232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:36.097681 22231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:36.097690 22226 server_base.cc:1034] running on GCE node
W20260618 23:23:36.097681 22234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:36.098047 22226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:36.098255 22226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:36.099412 22226 hybrid_clock.cc:648] HybridClock initialized: now 1781825016099402 us; error 30 us; skew 500 ppm
Jun 18 23:23:36 dist-test-slave-r9ct krb5kdc[21985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825016, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:36.101967 22226 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:23:36.102403 22226 webserver.cc:460] Webserver started at http://127.3.217.130:42321/ using document root <none> and password file <none>
I20260618 23:23:36.102632 22226 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:36.102701 22226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:36.102878 22226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:36.103910 22226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "d0b4d342156440a4921a2b82205b51cd"
format_stamp: "Formatted at 2026-06-18 23:23:36 on dist-test-slave-r9ct"
server_key: "09b5f88fb352ba10dcaefac39bf74336"
server_key_iv: "8675df0ffebf861282b73f29e65250d3"
server_key_version: "encryptionkey@0"
I20260618 23:23:36.104256 22226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "d0b4d342156440a4921a2b82205b51cd"
format_stamp: "Formatted at 2026-06-18 23:23:36 on dist-test-slave-r9ct"
server_key: "09b5f88fb352ba10dcaefac39bf74336"
server_key_iv: "8675df0ffebf861282b73f29e65250d3"
server_key_version: "encryptionkey@0"
I20260618 23:23:36.105567 22226 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:23:36.106381 22241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:36.106591 22226 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:36.106743 22226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "d0b4d342156440a4921a2b82205b51cd"
format_stamp: "Formatted at 2026-06-18 23:23:36 on dist-test-slave-r9ct"
server_key: "09b5f88fb352ba10dcaefac39bf74336"
server_key_iv: "8675df0ffebf861282b73f29e65250d3"
server_key_version: "encryptionkey@0"
I20260618 23:23:36.106835 22226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:36.133141 22226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:36.136822 22226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:36.136991 22226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:36.137275 22226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:23:36.137704 22226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:23:36.137766 22226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:36.137802 22226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:23:36.137835 22226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:36.144261 22226 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:37739
I20260618 23:23:36.144308 22354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:37739 every 8 connection(s)
I20260618 23:23:36.144606 22226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:23:36.150293 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 22226
I20260618 23:23:36.150398 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:23:36.150617 3942 external_mini_cluster.cc:1428] Setting key 239fd2a59978903af684d0e9b1dd691c
Jun 18 23:23:36 dist-test-slave-r9ct krb5kdc[21985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825016, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:23:36.154771 22088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.145420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:49513 (local address 127.3.217.190:37691)
0618 23:23:36.145492 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:36.145495 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:36.145543 (+ 48us) server_negotiation.cc:407] Connection header received
0618 23:23:36.146148 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:36.146149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:36.146160 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:36.146226 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:36.147308 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.147871 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.148871 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.149076 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.149184 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:36.151586 (+ 2402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:36.151587 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:36.151587 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:36.151594 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:36.153213 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:36.153726 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:36.153727 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:36.153727 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:36.153778 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:36.154053 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:36.154055 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:36.154055 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:36.154182 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:36.154296 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:36.154578 (+ 282us) server_negotiation.cc:299] Negotiation successful
0618 23:23:36.154659 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260618 23:23:36.154978 22357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.145267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37691 (local address 127.3.217.130:49513)
0618 23:23:36.145430 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:36.145471 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:36.145988 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:36.146303 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:36.146306 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:36.146954 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:23:36.147143 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:36.147147 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.147970 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.147971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:36.148784 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:36.148786 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.149224 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.149225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:36.149368 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:36.149915 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:23:36.149922 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:23:36.151489 (+ 1567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:23:36.153296 (+ 1807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:23:36.153303 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:23:36.153305 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:23:36.153629 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:23:36.153843 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:23:36.153844 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:23:36.153844 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:23:36.153974 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:23:36.154289 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:23:36.154296 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:23:36.154447 (+ 151us) client_negotiation.cc:769] Sending connection context
0618 23:23:36.154556 (+ 109us) client_negotiation.cc:240] Negotiation successful
0618 23:23:36.154745 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":95,"threads_started":1}
I20260618 23:23:36.155441 22355 heartbeater.cc:347] Connected to a master server at 127.3.217.190:37691
I20260618 23:23:36.155553 22355 heartbeater.cc:464] Registering TS with master...
I20260618 23:23:36.155758 22355 heartbeater.cc:511] Master 127.3.217.190:37691 requested a full tablet report, sending...
I20260618 23:23:36.156155 22030 ts_manager.cc:194] Registered new tserver with Master: d0b4d342156440a4921a2b82205b51cd (127.3.217.130:37739)
I20260618 23:23:36.156697 22030 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:49513
WARNING: no policy specified for kudu/127.3.217.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
I20260618 23:23:36.178913 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:37691
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:36.261315 22360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:36.261555 22360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:36.261595 22360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:36.262765 22360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:36.262835 22360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:36.262880 22360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:23:36.264344 22360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:37691
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:36.264608 22360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:36.264861 22360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:36.269930 22365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:36.269919 22366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:36.270139 22368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:36.270692 22360 server_base.cc:1034] running on GCE node
I20260618 23:23:36.271039 22360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:36.271387 22360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:36.272600 22360 hybrid_clock.cc:648] HybridClock initialized: now 1781825016272578 us; error 38 us; skew 500 ppm
Jun 18 23:23:36 dist-test-slave-r9ct krb5kdc[21985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825016, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:36.275648 22360 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:23:36.276103 22360 webserver.cc:460] Webserver started at http://127.3.217.131:33331/ using document root <none> and password file <none>
I20260618 23:23:36.276427 22360 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:36.276513 22360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:36.276647 22360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:36.277697 22360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "c588b508b9b64a65a8549b509884cb55"
format_stamp: "Formatted at 2026-06-18 23:23:36 on dist-test-slave-r9ct"
server_key: "8aefdd95219dbbddcba6e2cd1cdcea0c"
server_key_iv: "e3d891fa5a40c6b9fa49652648f3b20a"
server_key_version: "encryptionkey@0"
I20260618 23:23:36.278052 22360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "c588b508b9b64a65a8549b509884cb55"
format_stamp: "Formatted at 2026-06-18 23:23:36 on dist-test-slave-r9ct"
server_key: "8aefdd95219dbbddcba6e2cd1cdcea0c"
server_key_iv: "e3d891fa5a40c6b9fa49652648f3b20a"
server_key_version: "encryptionkey@0"
I20260618 23:23:36.279477 22360 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260618 23:23:36.280247 22375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:36.280490 22360 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260618 23:23:36.280593 22360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "c588b508b9b64a65a8549b509884cb55"
format_stamp: "Formatted at 2026-06-18 23:23:36 on dist-test-slave-r9ct"
server_key: "8aefdd95219dbbddcba6e2cd1cdcea0c"
server_key_iv: "e3d891fa5a40c6b9fa49652648f3b20a"
server_key_version: "encryptionkey@0"
I20260618 23:23:36.280680 22360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:36.315716 22360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:36.318019 22360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:36.318207 22360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:36.318473 22360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:23:36.318871 22360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:23:36.318934 22360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:36.318980 22360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:23:36.319010 22360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:36.325855 22360 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:41483
I20260618 23:23:36.325893 22488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:41483 every 8 connection(s)
I20260618 23:23:36.326288 22360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
Jun 18 23:23:36 dist-test-slave-r9ct krb5kdc[21985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825016, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:23:36.335165 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 22360
I20260618 23:23:36.335276 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:23:36.335500 3942 external_mini_cluster.cc:1428] Setting key a0c5f7bf0bb791f7e18cc8e736f6c026
I20260618 23:23:36.336372 22088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.327202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:41587 (local address 127.3.217.190:37691)
0618 23:23:36.327249 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:36.327252 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:36.327455 (+ 203us) server_negotiation.cc:407] Connection header received
0618 23:23:36.328022 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:36.328023 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:36.328033 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:36.328098 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:36.329129 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.329652 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.330650 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.330920 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.330979 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:36.333340 (+ 2361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:36.333341 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:36.333342 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:36.333347 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:36.334785 (+ 1438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:36.335257 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:36.335259 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:36.335259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:36.335323 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:36.335656 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:36.335658 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:36.335658 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:36.335797 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:36.335865 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:36.336189 (+ 324us) server_negotiation.cc:299] Negotiation successful
0618 23:23:36.336275 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260618 23:23:36.336561 22491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.327128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:37691 (local address 127.3.217.131:41587)
0618 23:23:36.327312 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:36.327357 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:36.327864 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:36.328177 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:36.328181 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:36.328817 (+ 636us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:23:36.329021 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:36.329025 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.329768 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.329769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:36.330565 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:36.330567 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.331004 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.331005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:36.331110 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:36.331572 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:23:36.331580 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:23:36.333190 (+ 1610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:23:36.334840 (+ 1650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:23:36.334845 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:23:36.334847 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:23:36.335145 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:23:36.335406 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:23:36.335407 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:23:36.335407 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:23:36.335544 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:23:36.335873 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:23:36.335880 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:23:36.336041 (+ 161us) client_negotiation.cc:769] Sending connection context
0618 23:23:36.336152 (+ 111us) client_negotiation.cc:240] Negotiation successful
0618 23:23:36.336321 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":91,"threads_started":1}
I20260618 23:23:36.337028 22489 heartbeater.cc:347] Connected to a master server at 127.3.217.190:37691
I20260618 23:23:36.337127 22489 heartbeater.cc:464] Registering TS with master...
I20260618 23:23:36.337282 22489 heartbeater.cc:511] Master 127.3.217.190:37691 requested a full tablet report, sending...
I20260618 23:23:36.337647 22030 ts_manager.cc:194] Registered new tserver with Master: c588b508b9b64a65a8549b509884cb55 (127.3.217.131:41483)
I20260618 23:23:36.338025 22030 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:41587
I20260618 23:23:36.347151 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260618 23:23:36.354522 22088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.348483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36838 (local address 127.3.217.190:37691)
0618 23:23:36.348535 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:36.348537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:36.348674 (+ 137us) server_negotiation.cc:407] Connection header received
0618 23:23:36.348749 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:36.348750 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:36.348760 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:36.348850 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:36.349410 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.349885 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.350607 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.350882 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.350965 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:36.352143 (+ 1178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:36.352144 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:36.352145 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:36.352151 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:36.353309 (+ 1158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:36.353683 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:36.353685 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:36.353685 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:36.353736 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:36.353986 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:36.353987 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:36.353987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:36.354114 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:36.354229 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:36.354361 (+ 132us) server_negotiation.cc:299] Negotiation successful
0618 23:23:36.354422 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260618 23:23:36.356704 22030 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36838:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:23:36.358392 22030 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:23:36.365136 22503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.361062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:37739 (local address 127.0.0.1:36716)
0618 23:23:36.361443 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:36.361452 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:36.361507 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:36.361745 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:36.361746 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:36.361748 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:36.361791 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:36.361793 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.363199 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.363200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:36.364113 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:36.364115 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.364816 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.364817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:36.364895 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:36.364909 (+ 14us) client_negotiation.cc:769] Sending connection context
0618 23:23:36.365008 (+ 99us) client_negotiation.cc:240] Negotiation successful
0618 23:23:36.365063 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"mutex_wait_us":2,"thread_start_us":72,"threads_started":1}
I20260618 23:23:36.365152 22505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.361274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36716 (local address 127.3.217.130:37739)
0618 23:23:36.361423 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:36.361427 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:36.361495 (+ 68us) server_negotiation.cc:407] Connection header received
0618 23:23:36.361580 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:36.361583 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:36.361598 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:36.361667 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:36.361869 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.363098 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.364210 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.364700 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.364812 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:36.364873 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:36.365026 (+ 153us) server_negotiation.cc:299] Negotiation successful
0618 23:23:36.365067 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":83,"threads_started":1}
I20260618 23:23:36.365316 22500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.360868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:41483 (local address 127.0.0.1:57976)
0618 23:23:36.361169 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:36.361181 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:36.361258 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:36.361479 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:36.361482 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:36.361485 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:36.361561 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:36.361563 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.362665 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.362666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:36.363994 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:36.363997 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.365029 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.365030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:36.365096 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:36.365100 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:23:36.365152 (+ 52us) client_negotiation.cc:240] Negotiation successful
0618 23:23:36.365207 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":2,"thread_start_us":64,"threads_started":1}
I20260618 23:23:36.365559 22504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.361070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57976 (local address 127.3.217.131:41483)
0618 23:23:36.361248 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:36.361254 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:36.361265 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:23:36.361336 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:36.361339 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:36.361354 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:36.361451 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:36.361652 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.362556 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.364096 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.364874 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.364943 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:36.364993 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:36.365425 (+ 432us) server_negotiation.cc:299] Negotiation successful
0618 23:23:36.365471 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":79,"threads_started":1}
I20260618 23:23:36.365855 22289 tablet_service.cc:1467] Processing CreateTablet for tablet 8dc494dbc00d4ca5b58a37864b58159c (DEFAULT_TABLE table=test-table [id=9e2e538504e74e08985cdb0b59b9089a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:23:36.366231 22289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dc494dbc00d4ca5b58a37864b58159c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:36.366273 22501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.360868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:41831 (local address 127.0.0.1:33674)
0618 23:23:36.361038 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:36.361075 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:36.361136 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:36.361790 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:36.361790 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:36.361792 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:36.361825 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:36.361827 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.363176 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.363177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:36.364435 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:36.364437 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.366029 (+ 1592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.366030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:36.366094 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:36.366114 (+ 20us) client_negotiation.cc:769] Sending connection context
0618 23:23:36.366148 (+ 34us) client_negotiation.cc:240] Negotiation successful
0618 23:23:36.366189 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":29,"thread_start_us":70,"threads_started":1}
I20260618 23:23:36.366245 22423 tablet_service.cc:1467] Processing CreateTablet for tablet 8dc494dbc00d4ca5b58a37864b58159c (DEFAULT_TABLE table=test-table [id=9e2e538504e74e08985cdb0b59b9089a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:23:36.366575 22423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dc494dbc00d4ca5b58a37864b58159c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:36.366598 22502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.360996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33674 (local address 127.3.217.129:41831)
0618 23:23:36.361624 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:36.361628 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:36.361637 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:23:36.361670 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:36.361672 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:36.361687 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:36.361896 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:36.361966 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.363063 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.364531 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.365921 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.366373 (+ 452us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:36.366437 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:36.366465 (+ 28us) server_negotiation.cc:299] Negotiation successful
0618 23:23:36.366509 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":88,"threads_started":1}
I20260618 23:23:36.369258 22506 tablet_bootstrap.cc:492] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd: Bootstrap starting.
I20260618 23:23:36.370134 22506 tablet_bootstrap.cc:654] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:36.370075 22155 tablet_service.cc:1467] Processing CreateTablet for tablet 8dc494dbc00d4ca5b58a37864b58159c (DEFAULT_TABLE table=test-table [id=9e2e538504e74e08985cdb0b59b9089a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:23:36.370393 22155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dc494dbc00d4ca5b58a37864b58159c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:36.370762 22506 log.cc:824] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:36.370901 22507 tablet_bootstrap.cc:492] T 8dc494dbc00d4ca5b58a37864b58159c P c588b508b9b64a65a8549b509884cb55: Bootstrap starting.
I20260618 23:23:36.371539 22507 tablet_bootstrap.cc:654] T 8dc494dbc00d4ca5b58a37864b58159c P c588b508b9b64a65a8549b509884cb55: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:36.371547 22506 tablet_bootstrap.cc:492] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd: No bootstrap required, opened a new log
I20260618 23:23:36.371608 22506 ts_tablet_manager.cc:1397] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260618 23:23:36.372110 22507 log.cc:824] T 8dc494dbc00d4ca5b58a37864b58159c P c588b508b9b64a65a8549b509884cb55: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:36.372861 22507 tablet_bootstrap.cc:492] T 8dc494dbc00d4ca5b58a37864b58159c P c588b508b9b64a65a8549b509884cb55: No bootstrap required, opened a new log
I20260618 23:23:36.372915 22507 ts_tablet_manager.cc:1397] T 8dc494dbc00d4ca5b58a37864b58159c P c588b508b9b64a65a8549b509884cb55: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:23:36.373288 22510 tablet_bootstrap.cc:492] T 8dc494dbc00d4ca5b58a37864b58159c P 899296a8d8794a24b451becd3d52260a: Bootstrap starting.
I20260618 23:23:36.373756 22510 tablet_bootstrap.cc:654] T 8dc494dbc00d4ca5b58a37864b58159c P 899296a8d8794a24b451becd3d52260a: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:36.373749 22506 raft_consensus.cc:348] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c588b508b9b64a65a8549b509884cb55" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41483 } } peers { permanent_uuid: "899296a8d8794a24b451becd3d52260a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 41831 } } peers { permanent_uuid: "d0b4d342156440a4921a2b82205b51cd" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37739 } }
I20260618 23:23:36.373924 22506 raft_consensus.cc:374] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:36.373960 22506 raft_consensus.cc:729] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0b4d342156440a4921a2b82205b51cd, State: Initialized, Role: FOLLOWER
I20260618 23:23:36.374073 22506 consensus_queue.cc:260] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c588b508b9b64a65a8549b509884cb55" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41483 } } peers { permanent_uuid: "899296a8d8794a24b451becd3d52260a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 41831 } } peers { permanent_uuid: "d0b4d342156440a4921a2b82205b51cd" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37739 } }
I20260618 23:23:36.374212 22510 log.cc:824] T 8dc494dbc00d4ca5b58a37864b58159c P 899296a8d8794a24b451becd3d52260a: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:36.374344 22506 ts_tablet_manager.cc:1428] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260618 23:23:36.374377 22355 heartbeater.cc:503] Master 127.3.217.190:37691 was elected leader, sending a full tablet report...
I20260618 23:23:36.375128 22507 raft_consensus.cc:348] T 8dc494dbc00d4ca5b58a37864b58159c P c588b508b9b64a65a8549b509884cb55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c588b508b9b64a65a8549b509884cb55" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41483 } } peers { permanent_uuid: "899296a8d8794a24b451becd3d52260a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 41831 } } peers { permanent_uuid: "d0b4d342156440a4921a2b82205b51cd" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37739 } }
I20260618 23:23:36.375293 22510 tablet_bootstrap.cc:492] T 8dc494dbc00d4ca5b58a37864b58159c P 899296a8d8794a24b451becd3d52260a: No bootstrap required, opened a new log
I20260618 23:23:36.375294 22507 raft_consensus.cc:374] T 8dc494dbc00d4ca5b58a37864b58159c P c588b508b9b64a65a8549b509884cb55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:36.375334 22507 raft_consensus.cc:729] T 8dc494dbc00d4ca5b58a37864b58159c P c588b508b9b64a65a8549b509884cb55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c588b508b9b64a65a8549b509884cb55, State: Initialized, Role: FOLLOWER
I20260618 23:23:36.375350 22510 ts_tablet_manager.cc:1397] T 8dc494dbc00d4ca5b58a37864b58159c P 899296a8d8794a24b451becd3d52260a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:23:36.375473 22507 consensus_queue.cc:260] T 8dc494dbc00d4ca5b58a37864b58159c P c588b508b9b64a65a8549b509884cb55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c588b508b9b64a65a8549b509884cb55" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41483 } } peers { permanent_uuid: "899296a8d8794a24b451becd3d52260a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 41831 } } peers { permanent_uuid: "d0b4d342156440a4921a2b82205b51cd" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37739 } }
I20260618 23:23:36.375718 22507 ts_tablet_manager.cc:1428] T 8dc494dbc00d4ca5b58a37864b58159c P c588b508b9b64a65a8549b509884cb55: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260618 23:23:36.375859 22489 heartbeater.cc:503] Master 127.3.217.190:37691 was elected leader, sending a full tablet report...
I20260618 23:23:36.376951 22510 raft_consensus.cc:348] T 8dc494dbc00d4ca5b58a37864b58159c P 899296a8d8794a24b451becd3d52260a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c588b508b9b64a65a8549b509884cb55" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41483 } } peers { permanent_uuid: "899296a8d8794a24b451becd3d52260a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 41831 } } peers { permanent_uuid: "d0b4d342156440a4921a2b82205b51cd" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37739 } }
I20260618 23:23:36.377102 22510 raft_consensus.cc:374] T 8dc494dbc00d4ca5b58a37864b58159c P 899296a8d8794a24b451becd3d52260a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:36.377140 22510 raft_consensus.cc:729] T 8dc494dbc00d4ca5b58a37864b58159c P 899296a8d8794a24b451becd3d52260a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899296a8d8794a24b451becd3d52260a, State: Initialized, Role: FOLLOWER
I20260618 23:23:36.377274 22510 consensus_queue.cc:260] T 8dc494dbc00d4ca5b58a37864b58159c P 899296a8d8794a24b451becd3d52260a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c588b508b9b64a65a8549b509884cb55" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41483 } } peers { permanent_uuid: "899296a8d8794a24b451becd3d52260a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 41831 } } peers { permanent_uuid: "d0b4d342156440a4921a2b82205b51cd" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37739 } }
I20260618 23:23:36.377506 22510 ts_tablet_manager.cc:1428] T 8dc494dbc00d4ca5b58a37864b58159c P 899296a8d8794a24b451becd3d52260a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:23:36.377559 22221 heartbeater.cc:503] Master 127.3.217.190:37691 was elected leader, sending a full tablet report...
W20260618 23:23:36.395196 22356 tablet.cc:2369] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 23:23:36.403446 22511 raft_consensus.cc:482] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:23:36.403553 22511 raft_consensus.cc:504] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c588b508b9b64a65a8549b509884cb55" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41483 } } peers { permanent_uuid: "899296a8d8794a24b451becd3d52260a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 41831 } } peers { permanent_uuid: "d0b4d342156440a4921a2b82205b51cd" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37739 } }
I20260618 23:23:36.403975 22511 leader_election.cc:288] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c588b508b9b64a65a8549b509884cb55 (127.3.217.131:41483), 899296a8d8794a24b451becd3d52260a (127.3.217.129:41831)
I20260618 23:23:36.407107 22502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.404290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:49463 (local address 127.3.217.129:41831)
0618 23:23:36.404338 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:36.404341 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:36.404351 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:23:36.404385 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:36.404386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:36.404396 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:36.404475 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:36.404709 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.405282 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.406245 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.406743 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.406803 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:36.406811 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:36.406989 (+ 178us) server_negotiation.cc:299] Negotiation successful
0618 23:23:36.407021 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260618 23:23:36.407117 22357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.404202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:41831 (local address 127.3.217.130:49463)
0618 23:23:36.404262 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:36.404275 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:36.404321 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:36.404547 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:36.404548 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:36.404550 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:36.404625 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:36.404627 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.405370 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.405371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:36.406140 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:36.406142 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.406808 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.406809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:36.406901 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:36.406905 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:23:36.406975 (+ 70us) client_negotiation.cc:240] Negotiation successful
0618 23:23:36.407017 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":31}
I20260618 23:23:36.407470 22504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.404327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:39063 (local address 127.3.217.131:41483)
0618 23:23:36.404372 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:36.404375 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:36.404529 (+ 154us) server_negotiation.cc:407] Connection header received
0618 23:23:36.404558 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:36.404559 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:36.404569 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:36.404642 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:36.404826 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.405289 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.406447 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.407032 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.407103 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:36.407110 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:36.407352 (+ 242us) server_negotiation.cc:299] Negotiation successful
0618 23:23:36.407396 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260618 23:23:36.407476 22175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc494dbc00d4ca5b58a37864b58159c" candidate_uuid: "d0b4d342156440a4921a2b82205b51cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899296a8d8794a24b451becd3d52260a" is_pre_election: true
I20260618 23:23:36.407639 22175 raft_consensus.cc:2454] T 8dc494dbc00d4ca5b58a37864b58159c P 899296a8d8794a24b451becd3d52260a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0b4d342156440a4921a2b82205b51cd in term 0.
I20260618 23:23:36.407729 22515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.404224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:41483 (local address 127.3.217.130:39063)
0618 23:23:36.404414 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:36.404426 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:36.404486 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:36.404655 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:36.404656 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:36.404677 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:36.404752 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:36.404754 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.405401 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.405402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:36.406287 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:36.406289 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.407165 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.407166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:36.407252 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:36.407257 (+ 5us) client_negotiation.cc:769] Sending connection context
0618 23:23:36.407599 (+ 342us) client_negotiation.cc:240] Negotiation successful
0618 23:23:36.407655 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":111,"threads_started":1}
I20260618 23:23:36.407940 22243 leader_election.cc:302] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899296a8d8794a24b451becd3d52260a, d0b4d342156440a4921a2b82205b51cd; no voters:
I20260618 23:23:36.408138 22511 raft_consensus.cc:2781] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:23:36.408107 22443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc494dbc00d4ca5b58a37864b58159c" candidate_uuid: "d0b4d342156440a4921a2b82205b51cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c588b508b9b64a65a8549b509884cb55" is_pre_election: true
I20260618 23:23:36.408221 22511 raft_consensus.cc:482] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:23:36.408262 22511 raft_consensus.cc:3037] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:36.408288 22443 raft_consensus.cc:2454] T 8dc494dbc00d4ca5b58a37864b58159c P c588b508b9b64a65a8549b509884cb55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0b4d342156440a4921a2b82205b51cd in term 0.
I20260618 23:23:36.409119 22511 raft_consensus.cc:504] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c588b508b9b64a65a8549b509884cb55" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41483 } } peers { permanent_uuid: "899296a8d8794a24b451becd3d52260a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 41831 } } peers { permanent_uuid: "d0b4d342156440a4921a2b82205b51cd" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37739 } }
I20260618 23:23:36.409286 22511 leader_election.cc:288] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd [CANDIDATE]: Term 1 election: Requested vote from peers c588b508b9b64a65a8549b509884cb55 (127.3.217.131:41483), 899296a8d8794a24b451becd3d52260a (127.3.217.129:41831)
I20260618 23:23:36.409412 22443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc494dbc00d4ca5b58a37864b58159c" candidate_uuid: "d0b4d342156440a4921a2b82205b51cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c588b508b9b64a65a8549b509884cb55"
I20260618 23:23:36.409508 22443 raft_consensus.cc:3037] T 8dc494dbc00d4ca5b58a37864b58159c P c588b508b9b64a65a8549b509884cb55 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:36.409473 22175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dc494dbc00d4ca5b58a37864b58159c" candidate_uuid: "d0b4d342156440a4921a2b82205b51cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899296a8d8794a24b451becd3d52260a"
I20260618 23:23:36.409564 22175 raft_consensus.cc:3037] T 8dc494dbc00d4ca5b58a37864b58159c P 899296a8d8794a24b451becd3d52260a [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:36.410488 22443 raft_consensus.cc:2454] T 8dc494dbc00d4ca5b58a37864b58159c P c588b508b9b64a65a8549b509884cb55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0b4d342156440a4921a2b82205b51cd in term 1.
I20260618 23:23:36.410619 22175 raft_consensus.cc:2454] T 8dc494dbc00d4ca5b58a37864b58159c P 899296a8d8794a24b451becd3d52260a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0b4d342156440a4921a2b82205b51cd in term 1.
I20260618 23:23:36.410670 22244 leader_election.cc:302] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c588b508b9b64a65a8549b509884cb55, d0b4d342156440a4921a2b82205b51cd; no voters:
I20260618 23:23:36.410821 22511 raft_consensus.cc:2781] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:36.411006 22511 raft_consensus.cc:686] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd [term 1 LEADER]: Becoming Leader. State: Replica: d0b4d342156440a4921a2b82205b51cd, State: Running, Role: LEADER
I20260618 23:23:36.411137 22511 consensus_queue.cc:237] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c588b508b9b64a65a8549b509884cb55" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41483 } } peers { permanent_uuid: "899296a8d8794a24b451becd3d52260a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 41831 } } peers { permanent_uuid: "d0b4d342156440a4921a2b82205b51cd" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37739 } }
I20260618 23:23:36.412046 22029 catalog_manager.cc:5495] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd reported cstate change: term changed from 0 to 1, leader changed from <none> to d0b4d342156440a4921a2b82205b51cd (127.3.217.130). New cstate: current_term: 1 leader_uuid: "d0b4d342156440a4921a2b82205b51cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c588b508b9b64a65a8549b509884cb55" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899296a8d8794a24b451becd3d52260a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 41831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0b4d342156440a4921a2b82205b51cd" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 37739 } health_report { overall_health: HEALTHY } } }
I20260618 23:23:36.428858 22505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.426164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36722 (local address 127.3.217.130:37739)
0618 23:23:36.426246 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:36.426248 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:36.426259 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:23:36.426304 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:36.426305 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:36.426326 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:36.426416 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:23:36.426691 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.427246 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.428073 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.428287 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.428344 (+ 57us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:36.428506 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:23:36.428590 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:23:36.428658 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:36.428762 (+ 104us) server_negotiation.cc:299] Negotiation successful
0618 23:23:36.428772 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260618 23:23:36.430917 22175 raft_consensus.cc:1261] T 8dc494dbc00d4ca5b58a37864b58159c P 899296a8d8794a24b451becd3d52260a [term 1 FOLLOWER]: Refusing update from remote peer d0b4d342156440a4921a2b82205b51cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:23:36.431041 22443 raft_consensus.cc:1261] T 8dc494dbc00d4ca5b58a37864b58159c P c588b508b9b64a65a8549b509884cb55 [term 1 FOLLOWER]: Refusing update from remote peer d0b4d342156440a4921a2b82205b51cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:23:36.431380 22516 consensus_queue.cc:1035] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "899296a8d8794a24b451becd3d52260a" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 41831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:23:36.431524 22511 consensus_queue.cc:1035] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c588b508b9b64a65a8549b509884cb55" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:23:36.434197 22521 mvcc.cc:205] Tried to move back new op lower bound from 7298355267297906688 to 7298355267220881408. Current Snapshot: MvccSnapshot[applied={T|T < 7298355267297906688}]
I20260618 23:23:36.434468 22520 mvcc.cc:205] Tried to move back new op lower bound from 7298355267297906688 to 7298355267220881408. Current Snapshot: MvccSnapshot[applied={T|T < 7298355267297906688}]
I20260618 23:23:36.436638 22030 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:23:36.436760 22030 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:23:36.437510 22030 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ceaf94dad5cf491ab29d153499e16e79: Sending DeleteTablet for 3 replicas of tablet 8dc494dbc00d4ca5b58a37864b58159c
I20260618 23:23:36.437866 22423 tablet_service.cc:1514] Processing DeleteTablet for tablet 8dc494dbc00d4ca5b58a37864b58159c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:23:36 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:57976
I20260618 23:23:36.437901 22155 tablet_service.cc:1514] Processing DeleteTablet for tablet 8dc494dbc00d4ca5b58a37864b58159c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:23:36 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:33674
I20260618 23:23:36.437882 22289 tablet_service.cc:1514] Processing DeleteTablet for tablet 8dc494dbc00d4ca5b58a37864b58159c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:23:36 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:36716
I20260618 23:23:36.438066 22528 tablet_replica.cc:330] T 8dc494dbc00d4ca5b58a37864b58159c P c588b508b9b64a65a8549b509884cb55: stopping tablet replica
I20260618 23:23:36.438158 22528 raft_consensus.cc:2229] T 8dc494dbc00d4ca5b58a37864b58159c P c588b508b9b64a65a8549b509884cb55 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:23:36.438267 22528 raft_consensus.cc:2258] T 8dc494dbc00d4ca5b58a37864b58159c P c588b508b9b64a65a8549b509884cb55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:23:36.438557 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 22092
I20260618 23:23:36.438835 22528 ts_tablet_manager.cc:1905] T 8dc494dbc00d4ca5b58a37864b58159c P c588b508b9b64a65a8549b509884cb55: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:23:36.440459 22528 ts_tablet_manager.cc:1918] T 8dc494dbc00d4ca5b58a37864b58159c P c588b508b9b64a65a8549b509884cb55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:23:36.440533 22528 log.cc:1196] T 8dc494dbc00d4ca5b58a37864b58159c P c588b508b9b64a65a8549b509884cb55: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/8dc494dbc00d4ca5b58a37864b58159c
I20260618 23:23:36.440810 22528 ts_tablet_manager.cc:1939] T 8dc494dbc00d4ca5b58a37864b58159c P c588b508b9b64a65a8549b509884cb55: Deleting consensus metadata
I20260618 23:23:36.441220 22016 catalog_manager.cc:4841] TS c588b508b9b64a65a8549b509884cb55 (127.3.217.131:41483): tablet 8dc494dbc00d4ca5b58a37864b58159c (table test-table [id=9e2e538504e74e08985cdb0b59b9089a]) successfully deleted
I20260618 23:23:36.442199 22530 tablet_replica.cc:330] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd: stopping tablet replica
I20260618 23:23:36.442310 22530 raft_consensus.cc:2229] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:23:36.442445 22530 raft_consensus.cc:2258] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260618 23:23:36.445883 22015 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.217.129:41831 (error 108)
I20260618 23:23:36.446368 22530 ts_tablet_manager.cc:1905] T 8dc494dbc00d4ca5b58a37864b58159c P d0b4d342156440a4921a2b82205b51cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:23:36.446484 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 22226
I20260618 23:23:36.447412 22501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.447263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:41831 (local address 127.0.0.1:33686)
0618 23:23:36.447329 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:36.447372 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.129:41831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260618 23:23:36.447540 22015 catalog_manager.cc:4584] TS 899296a8d8794a24b451becd3d52260a (127.3.217.129:41831): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8dc494dbc00d4ca5b58a37864b58159c: Network error: Client connection negotiation failed: client connection to 127.3.217.129:41831: connect: Connection refused (error 111)
I20260618 23:23:36.451776 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 22360
I20260618 23:23:36.451826 22501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.451695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:37739 (local address 127.0.0.1:36738)
0618 23:23:36.451761 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:36.451795 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.130:37739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260618 23:23:36.456092 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 21998
2026-06-18T23:23:36Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2008 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-06-18T23:23:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:23:36Z Disabled control of system clock
I20260618 23:23:36.485711 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:35305
--webserver_interface=127.3.217.190
--webserver_port=0
--builtin_ntp_servers=127.3.217.148:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:35305
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260618 23:23:36.568049 22535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:36.568249 22535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:36.568269 22535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:36.569331 22535 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:23:36.569373 22535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:36.569386 22535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:36.569399 22535 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:23:36.569411 22535 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:23:36.570781 22535 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:35305
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:35305
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22535
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:36.570967 22535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:36.571190 22535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:36.576238 22541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:36.576299 22540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:36.576511 22543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:36.576412 22535 server_base.cc:1034] running on GCE node
I20260618 23:23:36.576915 22535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:36.577260 22535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:36.578441 22535 hybrid_clock.cc:648] HybridClock initialized: now 1781825016578330 us; error 132 us; skew 500 ppm
I20260618 23:23:36.579825 22535 webserver.cc:460] Webserver started at http://127.3.217.190:38399/ using document root <none> and password file <none>
I20260618 23:23:36.580070 22535 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:36.580139 22535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:36.580288 22535 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:36.581380 22535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "3432ce9c8e5f45b698d2c3d7c49a601b"
format_stamp: "Formatted at 2026-06-18 23:23:36 on dist-test-slave-r9ct"
server_key: "a5eb219ed95d5083048c5a8179071937"
server_key_iv: "771cd090d6e014d3237a7ccedf8315cc"
server_key_version: "encryptionkey@0"
I20260618 23:23:36.581737 22535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "3432ce9c8e5f45b698d2c3d7c49a601b"
format_stamp: "Formatted at 2026-06-18 23:23:36 on dist-test-slave-r9ct"
server_key: "a5eb219ed95d5083048c5a8179071937"
server_key_iv: "771cd090d6e014d3237a7ccedf8315cc"
server_key_version: "encryptionkey@0"
I20260618 23:23:36.583328 22535 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260618 23:23:36.584540 22549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:36.584803 22535 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260618 23:23:36.584918 22535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "3432ce9c8e5f45b698d2c3d7c49a601b"
format_stamp: "Formatted at 2026-06-18 23:23:36 on dist-test-slave-r9ct"
server_key: "a5eb219ed95d5083048c5a8179071937"
server_key_iv: "771cd090d6e014d3237a7ccedf8315cc"
server_key_version: "encryptionkey@0"
I20260618 23:23:36.585008 22535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:36.595469 22535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:36.595762 22535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:36.595906 22535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:36.600376 22535 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:35305
I20260618 23:23:36.600538 22601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:35305 every 8 connection(s)
I20260618 23:23:36.600793 22535 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:23:36.601727 22602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:36.603926 22602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b: Bootstrap starting.
I20260618 23:23:36.604435 22602 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:36.604665 22602 log.cc:824] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:36.605263 22602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b: No bootstrap required, opened a new log
I20260618 23:23:36.606904 22602 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3432ce9c8e5f45b698d2c3d7c49a601b" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 35305 } }
I20260618 23:23:36.607029 22602 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:36.607051 22602 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3432ce9c8e5f45b698d2c3d7c49a601b, State: Initialized, Role: FOLLOWER
I20260618 23:23:36.607144 22602 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3432ce9c8e5f45b698d2c3d7c49a601b" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 35305 } }
I20260618 23:23:36.607219 22602 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:23:36.607251 22602 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:23:36.607302 22602 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:36.607823 22602 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3432ce9c8e5f45b698d2c3d7c49a601b" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 35305 } }
I20260618 23:23:36.607936 22602 leader_election.cc:302] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3432ce9c8e5f45b698d2c3d7c49a601b; no voters:
I20260618 23:23:36.608165 22602 leader_election.cc:288] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:23:36.608219 22605 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:36.608340 22605 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b [term 1 LEADER]: Becoming Leader. State: Replica: 3432ce9c8e5f45b698d2c3d7c49a601b, State: Running, Role: LEADER
I20260618 23:23:36.608418 22605 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3432ce9c8e5f45b698d2c3d7c49a601b" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 35305 } }
I20260618 23:23:36.608446 22602 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:23:36.608798 22606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3432ce9c8e5f45b698d2c3d7c49a601b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3432ce9c8e5f45b698d2c3d7c49a601b" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 35305 } } }
I20260618 23:23:36.608882 22606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:36.609061 22607 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3432ce9c8e5f45b698d2c3d7c49a601b. Latest consensus state: current_term: 1 leader_uuid: "3432ce9c8e5f45b698d2c3d7c49a601b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3432ce9c8e5f45b698d2c3d7c49a601b" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 35305 } } }
I20260618 23:23:36.609141 22607 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:36.609560 22613 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:23:36.610059 22613 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:23:36.610356 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 22535
I20260618 23:23:36.610487 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:23:36.610674 3942 external_mini_cluster.cc:1428] Setting key 8fc10bb4f3777aa92ea670ab532d331d
I20260618 23:23:36.615309 22613 catalog_manager.cc:1347] Generated new cluster ID: cee9933046d74f8c91aadb048f17f976
I20260618 23:23:36.615367 22613 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:23:36.619650 22625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.611311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42970 (local address 127.3.217.190:35305)
0618 23:23:36.611501 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:36.611513 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:36.611536 (+ 23us) server_negotiation.cc:407] Connection header received
0618 23:23:36.611619 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:36.611624 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:36.611672 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:36.611791 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:36.612012 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.612872 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.614125 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.614536 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.614634 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:36.618961 (+ 4327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:36.618965 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:36.618965 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:36.619148 (+ 183us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:36.619179 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:36.619189 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:36.619312 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:36.619386 (+ 74us) server_negotiation.cc:299] Negotiation successful
0618 23:23:36.619478 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":91,"threads_started":1}
I20260618 23:23:36.623000 22613 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:23:36.623472 22613 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:23:36.630985 22613 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b: Generated new TSK 0
I20260618 23:23:36.631196 22613 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:23:36.637037 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:35305
--builtin_ntp_servers=127.3.217.148:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260618 23:23:36.746186 22626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:36.746433 22626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:36.746470 22626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:36.747712 22626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:36.747779 22626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:36.747824 22626 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:23:36.749197 22626 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:35305
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22626
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:36.749488 22626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:36.749784 22626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:36.754855 22631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:36.755004 22632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:36.755113 22634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:36.755373 22626 server_base.cc:1034] running on GCE node
I20260618 23:23:36.755586 22626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:36.755846 22626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:36.757025 22626 hybrid_clock.cc:648] HybridClock initialized: now 1781825016757011 us; error 32 us; skew 500 ppm
I20260618 23:23:36.758606 22626 webserver.cc:460] Webserver started at http://127.3.217.129:42877/ using document root <none> and password file <none>
I20260618 23:23:36.758890 22626 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:36.758962 22626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:36.759115 22626 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:36.760138 22626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "a5710005aa8e40c78b4f359c0f07a426"
format_stamp: "Formatted at 2026-06-18 23:23:36 on dist-test-slave-r9ct"
server_key: "484f691a4b73d608ab7e65a99f8dd401"
server_key_iv: "353f914eef286c3c10a6629689a807fb"
server_key_version: "encryptionkey@0"
I20260618 23:23:36.760496 22626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "a5710005aa8e40c78b4f359c0f07a426"
format_stamp: "Formatted at 2026-06-18 23:23:36 on dist-test-slave-r9ct"
server_key: "484f691a4b73d608ab7e65a99f8dd401"
server_key_iv: "353f914eef286c3c10a6629689a807fb"
server_key_version: "encryptionkey@0"
I20260618 23:23:36.761834 22626 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:23:36.762663 22640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:36.762861 22626 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:36.762962 22626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "a5710005aa8e40c78b4f359c0f07a426"
format_stamp: "Formatted at 2026-06-18 23:23:36 on dist-test-slave-r9ct"
server_key: "484f691a4b73d608ab7e65a99f8dd401"
server_key_iv: "353f914eef286c3c10a6629689a807fb"
server_key_version: "encryptionkey@0"
I20260618 23:23:36.763046 22626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:36.772018 22626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:36.772305 22626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:36.772459 22626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:36.772681 22626 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:23:36.772987 22626 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:23:36.773041 22626 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:36.773079 22626 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:23:36.773108 22626 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:36.779654 22626 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:41363
I20260618 23:23:36.779695 22753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:41363 every 8 connection(s)
I20260618 23:23:36.780035 22626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:23:36.782821 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 22626
I20260618 23:23:36.782970 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:23:36.783218 3942 external_mini_cluster.cc:1428] Setting key 626543306159fc2281544f83b5a7fe2b
I20260618 23:23:36.784318 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:35305
--builtin_ntp_servers=127.3.217.148:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260618 23:23:36.785725 22625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.780755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:34599 (local address 127.3.217.190:35305)
0618 23:23:36.780830 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:36.780832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:36.781052 (+ 220us) server_negotiation.cc:407] Connection header received
0618 23:23:36.781499 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:36.781500 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:36.781511 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:36.781563 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:36.782159 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.782654 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.783995 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.784354 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.784445 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:36.785386 (+ 941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:36.785388 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:36.785388 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:36.785394 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:36.785411 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:36.785417 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:36.785481 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:36.785564 (+ 83us) server_negotiation.cc:299] Negotiation successful
0618 23:23:36.785604 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260618 23:23:36.785950 22756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.780719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:35305 (local address 127.3.217.129:34599)
0618 23:23:36.780925 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:36.780957 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:36.781417 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:36.781611 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:36.781614 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:36.781621 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:23:36.782091 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:36.782094 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.782795 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.782796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:36.783905 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:36.783908 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.784468 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.784470 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:36.784633 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:36.785241 (+ 608us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:23:36.785241 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:23:36.785269 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:23:36.785291 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:23:36.785487 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:23:36.785491 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:23:36.785493 (+ 2us) client_negotiation.cc:769] Sending connection context
0618 23:23:36.785543 (+ 50us) client_negotiation.cc:240] Negotiation successful
0618 23:23:36.785681 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":110,"threads_started":1}
I20260618 23:23:36.786512 22754 heartbeater.cc:347] Connected to a master server at 127.3.217.190:35305
I20260618 23:23:36.786600 22754 heartbeater.cc:464] Registering TS with master...
I20260618 23:23:36.786826 22754 heartbeater.cc:511] Master 127.3.217.190:35305 requested a full tablet report, sending...
I20260618 23:23:36.787339 22566 ts_manager.cc:194] Registered new tserver with Master: a5710005aa8e40c78b4f359c0f07a426 (127.3.217.129:41363)
I20260618 23:23:36.788254 22566 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.217.129:34599
W20260618 23:23:36.870038 22757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:36.870234 22757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:36.870256 22757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:36.871349 22757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:36.871384 22757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:36.871409 22757 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:23:36.872655 22757 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:35305
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:36.872833 22757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:36.873060 22757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:36.877980 22762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:36.878057 22763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:36.878074 22765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:36.878494 22757 server_base.cc:1034] running on GCE node
I20260618 23:23:36.878990 22757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:36.879364 22757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:36.880604 22757 hybrid_clock.cc:648] HybridClock initialized: now 1781825016880566 us; error 61 us; skew 500 ppm
I20260618 23:23:36.882267 22757 webserver.cc:460] Webserver started at http://127.3.217.130:43303/ using document root <none> and password file <none>
I20260618 23:23:36.882506 22757 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:36.882556 22757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:36.882674 22757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:36.883898 22757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "d800a72c3ec04ec584bd08c07ce70523"
format_stamp: "Formatted at 2026-06-18 23:23:36 on dist-test-slave-r9ct"
server_key: "51e09ab25c7e368bea567badfcd2f54a"
server_key_iv: "4ee678ad132ec3b46730938e35687bce"
server_key_version: "encryptionkey@0"
I20260618 23:23:36.884229 22757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "d800a72c3ec04ec584bd08c07ce70523"
format_stamp: "Formatted at 2026-06-18 23:23:36 on dist-test-slave-r9ct"
server_key: "51e09ab25c7e368bea567badfcd2f54a"
server_key_iv: "4ee678ad132ec3b46730938e35687bce"
server_key_version: "encryptionkey@0"
I20260618 23:23:36.885605 22757 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:23:36.886512 22771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:36.886772 22757 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:36.887164 22757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "d800a72c3ec04ec584bd08c07ce70523"
format_stamp: "Formatted at 2026-06-18 23:23:36 on dist-test-slave-r9ct"
server_key: "51e09ab25c7e368bea567badfcd2f54a"
server_key_iv: "4ee678ad132ec3b46730938e35687bce"
server_key_version: "encryptionkey@0"
I20260618 23:23:36.887259 22757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:36.906862 22757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:36.907117 22757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:36.907218 22757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:36.907395 22757 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:23:36.907963 22757 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:23:36.908006 22757 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:36.908028 22757 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:23:36.908041 22757 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:36.914503 22757 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:43631
I20260618 23:23:36.914580 22884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:43631 every 8 connection(s)
I20260618 23:23:36.914896 22757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:23:36.920147 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 22757
I20260618 23:23:36.920275 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:23:36.920549 3942 external_mini_cluster.cc:1428] Setting key 7bcab09876541ca1c07c5187d6f8df60
I20260618 23:23:36.920770 22625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.915861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:48399 (local address 127.3.217.190:35305)
0618 23:23:36.915956 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:36.915963 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:36.916160 (+ 197us) server_negotiation.cc:407] Connection header received
0618 23:23:36.916667 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:36.916669 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:36.916679 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:36.916773 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:36.917401 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.917895 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.919080 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.919295 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.919362 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:36.920470 (+ 1108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:36.920472 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:36.920472 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:36.920477 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:36.920494 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:36.920499 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:36.920565 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:36.920659 (+ 94us) server_negotiation.cc:299] Negotiation successful
0618 23:23:36.920686 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260618 23:23:36.920996 22887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:36.915841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:35305 (local address 127.3.217.130:48399)
0618 23:23:36.916026 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:36.916066 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:36.916551 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:36.916822 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:36.916825 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:36.916832 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:23:36.917319 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:36.917323 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.917982 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.917983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:36.918866 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:36.918868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:36.919412 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:36.919413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:36.919539 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:36.920164 (+ 625us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:23:36.920164 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:23:36.920192 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:23:36.920213 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:23:36.920571 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:23:36.920576 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:23:36.920578 (+ 2us) client_negotiation.cc:769] Sending connection context
0618 23:23:36.920657 (+ 79us) client_negotiation.cc:240] Negotiation successful
0618 23:23:36.920754 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":86,"threads_started":1}
I20260618 23:23:36.921639 22885 heartbeater.cc:347] Connected to a master server at 127.3.217.190:35305
I20260618 23:23:36.921730 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:35305
--builtin_ntp_servers=127.3.217.148:46689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260618 23:23:36.921753 22885 heartbeater.cc:464] Registering TS with master...
I20260618 23:23:36.921950 22885 heartbeater.cc:511] Master 127.3.217.190:35305 requested a full tablet report, sending...
I20260618 23:23:36.922377 22566 ts_manager.cc:194] Registered new tserver with Master: d800a72c3ec04ec584bd08c07ce70523 (127.3.217.130:43631)
I20260618 23:23:36.922819 22566 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.217.130:48399
W20260618 23:23:37.006613 22888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:37.006908 22888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:37.006935 22888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:37.008209 22888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:37.008252 22888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:37.008279 22888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:23:37.010213 22888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:46689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:35305
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:37.010592 22888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:37.010947 22888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:37.016885 22893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:37.016899 22896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:37.016939 22894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:37.017373 22888 server_base.cc:1034] running on GCE node
I20260618 23:23:37.017596 22888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:37.017864 22888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:37.019233 22888 hybrid_clock.cc:648] HybridClock initialized: now 1781825017019201 us; error 41 us; skew 500 ppm
I20260618 23:23:37.021222 22888 webserver.cc:460] Webserver started at http://127.3.217.131:35989/ using document root <none> and password file <none>
I20260618 23:23:37.021562 22888 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:37.021615 22888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:37.021754 22888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:37.022919 22888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "8ea58df5473a4c08bf07c01b06c97fce"
format_stamp: "Formatted at 2026-06-18 23:23:37 on dist-test-slave-r9ct"
server_key: "5ab8eba0ac0fd2a10329171890420faa"
server_key_iv: "a212fc4d24302a1ebe56475e78220f7e"
server_key_version: "encryptionkey@0"
I20260618 23:23:37.023294 22888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "8ea58df5473a4c08bf07c01b06c97fce"
format_stamp: "Formatted at 2026-06-18 23:23:37 on dist-test-slave-r9ct"
server_key: "5ab8eba0ac0fd2a10329171890420faa"
server_key_iv: "a212fc4d24302a1ebe56475e78220f7e"
server_key_version: "encryptionkey@0"
I20260618 23:23:37.024590 22888 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260618 23:23:37.025465 22902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:37.025691 22888 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:37.025794 22888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "8ea58df5473a4c08bf07c01b06c97fce"
format_stamp: "Formatted at 2026-06-18 23:23:37 on dist-test-slave-r9ct"
server_key: "5ab8eba0ac0fd2a10329171890420faa"
server_key_iv: "a212fc4d24302a1ebe56475e78220f7e"
server_key_version: "encryptionkey@0"
I20260618 23:23:37.025882 22888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:37.035331 22888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:37.035563 22888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:37.035660 22888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:37.035837 22888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:23:37.036089 22888 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:23:37.036118 22888 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:37.036139 22888 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:23:37.036151 22888 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:37.041512 22888 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:44997
I20260618 23:23:37.041673 23015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:44997 every 8 connection(s)
I20260618 23:23:37.041906 22888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:23:37.047041 22625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:37.042622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:56565 (local address 127.3.217.190:35305)
0618 23:23:37.042683 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:37.042685 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:37.042929 (+ 244us) server_negotiation.cc:407] Connection header received
0618 23:23:37.043363 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:37.043364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:37.043374 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:37.043436 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:37.044098 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.044615 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.045587 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.045807 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.045869 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:37.046656 (+ 787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:37.046657 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:37.046658 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:37.046661 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:37.046674 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:37.046678 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:37.046823 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:37.046917 (+ 94us) server_negotiation.cc:299] Negotiation successful
0618 23:23:37.046943 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260618 23:23:37.047165 23018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:37.042569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:35305 (local address 127.3.217.131:56565)
0618 23:23:37.042775 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:37.042813 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:37.043256 (+ 443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:37.043509 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:37.043512 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:37.043520 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:23:37.043998 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:37.044002 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.044734 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.044735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:37.045489 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:37.045491 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.045912 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.045913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:37.046029 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:37.046528 (+ 499us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:23:37.046528 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:23:37.046554 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:23:37.046575 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:23:37.046830 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:23:37.046834 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:23:37.046837 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:23:37.046904 (+ 67us) client_negotiation.cc:240] Negotiation successful
0618 23:23:37.046978 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":87,"threads_started":1}
I20260618 23:23:37.047210 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 22888
I20260618 23:23:37.047310 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:23:37.047509 3942 external_mini_cluster.cc:1428] Setting key 7092c18a8625f88b29033d32ba682580
I20260618 23:23:37.047797 23016 heartbeater.cc:347] Connected to a master server at 127.3.217.190:35305
I20260618 23:23:37.047907 23016 heartbeater.cc:464] Registering TS with master...
I20260618 23:23:37.048102 23016 heartbeater.cc:511] Master 127.3.217.190:35305 requested a full tablet report, sending...
I20260618 23:23:37.048493 22566 ts_manager.cc:194] Registered new tserver with Master: 8ea58df5473a4c08bf07c01b06c97fce (127.3.217.131:44997)
I20260618 23:23:37.048877 22566 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.217.131:56565
I20260618 23:23:37.059304 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260618 23:23:37.063652 22625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:37.060614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42976 (local address 127.3.217.190:35305)
0618 23:23:37.060675 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:37.060678 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:37.060803 (+ 125us) server_negotiation.cc:407] Connection header received
0618 23:23:37.060871 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:37.060872 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:37.060887 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:37.060957 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:37.061124 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.061608 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.062354 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.062543 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.062617 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:37.063363 (+ 746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:37.063364 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:37.063365 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:37.063370 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:37.063383 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:37.063387 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:37.063477 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:37.063555 (+ 78us) server_negotiation.cc:299] Negotiation successful
0618 23:23:37.063566 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260618 23:23:37.065353 22566 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42976:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:23:37.067003 22566 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:23:37.073366 23025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:37.069311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:43631 (local address 127.0.0.1:50228)
0618 23:23:37.069521 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:37.069560 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:37.069624 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:37.069869 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:37.069871 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:37.069874 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:37.069935 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:37.069937 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.071037 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.071038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:37.072299 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:37.072302 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.073042 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.073043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:37.073122 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:37.073136 (+ 14us) client_negotiation.cc:769] Sending connection context
0618 23:23:37.073234 (+ 98us) client_negotiation.cc:240] Negotiation successful
0618 23:23:37.073287 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":28,"spinlock_wait_cycles":1920,"thread_start_us":130,"threads_started":1}
I20260618 23:23:37.073377 23028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:37.069519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50228 (local address 127.3.217.130:43631)
0618 23:23:37.069704 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:37.069709 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:37.069718 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:23:37.069763 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:37.069765 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:37.069776 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:37.069865 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:37.070022 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.070956 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.072384 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.072943 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.073027 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:37.073115 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:37.073251 (+ 136us) server_negotiation.cc:299] Negotiation successful
0618 23:23:37.073287 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":83,"threads_started":1}
I20260618 23:23:37.073606 23024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:37.069313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:44997 (local address 127.0.0.1:60152)
0618 23:23:37.069946 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:37.069956 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:37.070002 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:37.070306 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:37.070307 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:37.070309 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:37.070343 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:37.070344 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.071557 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.071558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:37.072463 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:37.072465 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.073377 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.073379 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:37.073447 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:37.073451 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:23:37.073497 (+ 46us) client_negotiation.cc:240] Negotiation successful
0618 23:23:37.073531 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"mutex_wait_us":3,"thread_start_us":92,"threads_started":1}
I20260618 23:23:37.073786 23026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:37.069313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:41363 (local address 127.0.0.1:38384)
0618 23:23:37.069680 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:37.069691 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:37.069747 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:37.070007 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:37.070008 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:37.070011 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:37.070054 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:37.070055 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.071334 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.071334 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:37.072391 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:37.072393 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.073379 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.073379 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:37.073640 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:37.073644 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:23:37.073695 (+ 51us) client_negotiation.cc:240] Negotiation successful
0618 23:23:37.073731 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"mutex_wait_us":4,"thread_start_us":92,"threads_started":1}
I20260618 23:23:37.073838 23027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:37.069511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60152 (local address 127.3.217.131:44997)
0618 23:23:37.069865 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:37.069870 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:37.070059 (+ 189us) server_negotiation.cc:407] Connection header received
0618 23:23:37.070100 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:37.070102 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:37.070116 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:37.070180 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:37.070433 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.071477 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.072544 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.073208 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.073265 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:37.073340 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:37.073718 (+ 378us) server_negotiation.cc:299] Negotiation successful
0618 23:23:37.073757 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":78,"threads_started":1}
I20260618 23:23:37.074051 23029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:37.069543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38384 (local address 127.3.217.129:41363)
0618 23:23:37.069718 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:37.069722 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:37.069735 (+ 13us) server_negotiation.cc:407] Connection header received
0618 23:23:37.069829 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:37.069831 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:37.069848 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:37.069941 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:37.070130 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.071248 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.072464 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.073172 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.073263 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:37.073340 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:37.073937 (+ 597us) server_negotiation.cc:299] Negotiation successful
0618 23:23:37.073977 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":73,"threads_started":1}
I20260618 23:23:37.074246 22819 tablet_service.cc:1467] Processing CreateTablet for tablet 7ad7338762be4a739d7dced5bed6f1d4 (DEFAULT_TABLE table=test-table [id=5d517fc3193a4f269e7ad1f0f2425778]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:23:37.074394 22950 tablet_service.cc:1467] Processing CreateTablet for tablet 7ad7338762be4a739d7dced5bed6f1d4 (DEFAULT_TABLE table=test-table [id=5d517fc3193a4f269e7ad1f0f2425778]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:23:37.074630 22819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ad7338762be4a739d7dced5bed6f1d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:37.074657 22950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ad7338762be4a739d7dced5bed6f1d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:37.074656 22685 tablet_service.cc:1467] Processing CreateTablet for tablet 7ad7338762be4a739d7dced5bed6f1d4 (DEFAULT_TABLE table=test-table [id=5d517fc3193a4f269e7ad1f0f2425778]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:23:37.075018 22685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ad7338762be4a739d7dced5bed6f1d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:37.077664 23030 tablet_bootstrap.cc:492] T 7ad7338762be4a739d7dced5bed6f1d4 P a5710005aa8e40c78b4f359c0f07a426: Bootstrap starting.
I20260618 23:23:37.078414 23032 tablet_bootstrap.cc:492] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523: Bootstrap starting.
I20260618 23:23:37.078516 23030 tablet_bootstrap.cc:654] T 7ad7338762be4a739d7dced5bed6f1d4 P a5710005aa8e40c78b4f359c0f07a426: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:37.078869 23030 log.cc:824] T 7ad7338762be4a739d7dced5bed6f1d4 P a5710005aa8e40c78b4f359c0f07a426: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:37.079023 23032 tablet_bootstrap.cc:654] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:37.079312 23032 log.cc:824] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:37.079581 23030 tablet_bootstrap.cc:492] T 7ad7338762be4a739d7dced5bed6f1d4 P a5710005aa8e40c78b4f359c0f07a426: No bootstrap required, opened a new log
I20260618 23:23:37.079661 23030 ts_tablet_manager.cc:1397] T 7ad7338762be4a739d7dced5bed6f1d4 P a5710005aa8e40c78b4f359c0f07a426: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:23:37.079653 23031 tablet_bootstrap.cc:492] T 7ad7338762be4a739d7dced5bed6f1d4 P 8ea58df5473a4c08bf07c01b06c97fce: Bootstrap starting.
I20260618 23:23:37.080132 23031 tablet_bootstrap.cc:654] T 7ad7338762be4a739d7dced5bed6f1d4 P 8ea58df5473a4c08bf07c01b06c97fce: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:37.080363 23031 log.cc:824] T 7ad7338762be4a739d7dced5bed6f1d4 P 8ea58df5473a4c08bf07c01b06c97fce: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:37.080835 23032 tablet_bootstrap.cc:492] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523: No bootstrap required, opened a new log
I20260618 23:23:37.080886 23032 ts_tablet_manager.cc:1397] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260618 23:23:37.081835 23030 raft_consensus.cc:348] T 7ad7338762be4a739d7dced5bed6f1d4 P a5710005aa8e40c78b4f359c0f07a426 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ea58df5473a4c08bf07c01b06c97fce" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 44997 } } peers { permanent_uuid: "a5710005aa8e40c78b4f359c0f07a426" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 41363 } } peers { permanent_uuid: "d800a72c3ec04ec584bd08c07ce70523" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43631 } }
I20260618 23:23:37.081990 23030 raft_consensus.cc:374] T 7ad7338762be4a739d7dced5bed6f1d4 P a5710005aa8e40c78b4f359c0f07a426 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:37.082037 23030 raft_consensus.cc:729] T 7ad7338762be4a739d7dced5bed6f1d4 P a5710005aa8e40c78b4f359c0f07a426 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5710005aa8e40c78b4f359c0f07a426, State: Initialized, Role: FOLLOWER
I20260618 23:23:37.082144 23030 consensus_queue.cc:260] T 7ad7338762be4a739d7dced5bed6f1d4 P a5710005aa8e40c78b4f359c0f07a426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ea58df5473a4c08bf07c01b06c97fce" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 44997 } } peers { permanent_uuid: "a5710005aa8e40c78b4f359c0f07a426" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 41363 } } peers { permanent_uuid: "d800a72c3ec04ec584bd08c07ce70523" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43631 } }
I20260618 23:23:37.082458 22754 heartbeater.cc:503] Master 127.3.217.190:35305 was elected leader, sending a full tablet report...
I20260618 23:23:37.082777 23030 ts_tablet_manager.cc:1428] T 7ad7338762be4a739d7dced5bed6f1d4 P a5710005aa8e40c78b4f359c0f07a426: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260618 23:23:37.083705 23032 raft_consensus.cc:348] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ea58df5473a4c08bf07c01b06c97fce" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 44997 } } peers { permanent_uuid: "a5710005aa8e40c78b4f359c0f07a426" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 41363 } } peers { permanent_uuid: "d800a72c3ec04ec584bd08c07ce70523" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43631 } }
I20260618 23:23:37.084054 23032 raft_consensus.cc:374] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:37.084082 23032 raft_consensus.cc:729] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d800a72c3ec04ec584bd08c07ce70523, State: Initialized, Role: FOLLOWER
I20260618 23:23:37.084815 23031 tablet_bootstrap.cc:492] T 7ad7338762be4a739d7dced5bed6f1d4 P 8ea58df5473a4c08bf07c01b06c97fce: No bootstrap required, opened a new log
I20260618 23:23:37.084908 23031 ts_tablet_manager.cc:1397] T 7ad7338762be4a739d7dced5bed6f1d4 P 8ea58df5473a4c08bf07c01b06c97fce: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260618 23:23:37.086860 23032 consensus_queue.cc:260] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ea58df5473a4c08bf07c01b06c97fce" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 44997 } } peers { permanent_uuid: "a5710005aa8e40c78b4f359c0f07a426" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 41363 } } peers { permanent_uuid: "d800a72c3ec04ec584bd08c07ce70523" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43631 } }
I20260618 23:23:37.086936 23031 raft_consensus.cc:348] T 7ad7338762be4a739d7dced5bed6f1d4 P 8ea58df5473a4c08bf07c01b06c97fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ea58df5473a4c08bf07c01b06c97fce" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 44997 } } peers { permanent_uuid: "a5710005aa8e40c78b4f359c0f07a426" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 41363 } } peers { permanent_uuid: "d800a72c3ec04ec584bd08c07ce70523" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43631 } }
I20260618 23:23:37.087154 23031 raft_consensus.cc:374] T 7ad7338762be4a739d7dced5bed6f1d4 P 8ea58df5473a4c08bf07c01b06c97fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:37.087209 23031 raft_consensus.cc:729] T 7ad7338762be4a739d7dced5bed6f1d4 P 8ea58df5473a4c08bf07c01b06c97fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ea58df5473a4c08bf07c01b06c97fce, State: Initialized, Role: FOLLOWER
I20260618 23:23:37.087303 22885 heartbeater.cc:503] Master 127.3.217.190:35305 was elected leader, sending a full tablet report...
I20260618 23:23:37.087332 23032 ts_tablet_manager.cc:1428] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260618 23:23:37.087342 23031 consensus_queue.cc:260] T 7ad7338762be4a739d7dced5bed6f1d4 P 8ea58df5473a4c08bf07c01b06c97fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ea58df5473a4c08bf07c01b06c97fce" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 44997 } } peers { permanent_uuid: "a5710005aa8e40c78b4f359c0f07a426" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 41363 } } peers { permanent_uuid: "d800a72c3ec04ec584bd08c07ce70523" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43631 } }
I20260618 23:23:37.087623 23031 ts_tablet_manager.cc:1428] T 7ad7338762be4a739d7dced5bed6f1d4 P 8ea58df5473a4c08bf07c01b06c97fce: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260618 23:23:37.087688 23016 heartbeater.cc:503] Master 127.3.217.190:35305 was elected leader, sending a full tablet report...
I20260618 23:23:37.115253 23037 raft_consensus.cc:482] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:23:37.115398 23037 raft_consensus.cc:504] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ea58df5473a4c08bf07c01b06c97fce" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 44997 } } peers { permanent_uuid: "a5710005aa8e40c78b4f359c0f07a426" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 41363 } } peers { permanent_uuid: "d800a72c3ec04ec584bd08c07ce70523" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43631 } }
I20260618 23:23:37.115705 23037 leader_election.cc:288] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ea58df5473a4c08bf07c01b06c97fce (127.3.217.131:44997), a5710005aa8e40c78b4f359c0f07a426 (127.3.217.129:41363)
I20260618 23:23:37.119961 22887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:37.115929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:44997 (local address 127.3.217.130:37593)
0618 23:23:37.115997 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:37.116010 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:37.116058 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:37.116266 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:37.116267 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:37.116269 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:37.116367 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:37.116369 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.117308 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.117309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:37.118838 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:37.118841 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.119688 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.119690 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:37.119764 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:37.119768 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:23:37.119832 (+ 64us) client_negotiation.cc:240] Negotiation successful
0618 23:23:37.119887 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":66}
I20260618 23:23:37.120004 23029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:37.116035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:49845 (local address 127.3.217.129:41363)
0618 23:23:37.116089 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:37.116091 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:37.116205 (+ 114us) server_negotiation.cc:407] Connection header received
0618 23:23:37.116233 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:37.116234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:37.116246 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:37.116300 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:37.116464 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.117211 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.118975 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.119569 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.119644 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:37.119652 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:37.119896 (+ 244us) server_negotiation.cc:299] Negotiation successful
0618 23:23:37.119935 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260618 23:23:37.119997 23027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:37.116035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:37593 (local address 127.3.217.131:44997)
0618 23:23:37.116085 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:37.116088 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:37.116121 (+ 33us) server_negotiation.cc:407] Connection header received
0618 23:23:37.116156 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:37.116156 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:37.116165 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:37.116241 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:37.116461 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.117195 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.118978 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.119569 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.119645 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:37.119652 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:37.119857 (+ 205us) server_negotiation.cc:299] Negotiation successful
0618 23:23:37.119915 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260618 23:23:37.120205 23039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:37.115929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:41363 (local address 127.3.217.130:49845)
0618 23:23:37.116108 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:37.116118 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:37.116187 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:37.116310 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:37.116310 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:37.116312 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:37.116369 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:37.116370 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.117308 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.117309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:37.118843 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:37.118844 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.119698 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.119698 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:37.119806 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:37.119809 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:23:37.120070 (+ 261us) client_negotiation.cc:240] Negotiation successful
0618 23:23:37.120112 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":119,"thread_start_us":101,"threads_started":1}
I20260618 23:23:37.120326 22970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ad7338762be4a739d7dced5bed6f1d4" candidate_uuid: "d800a72c3ec04ec584bd08c07ce70523" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ea58df5473a4c08bf07c01b06c97fce" is_pre_election: true
I20260618 23:23:37.120509 22970 raft_consensus.cc:2454] T 7ad7338762be4a739d7dced5bed6f1d4 P 8ea58df5473a4c08bf07c01b06c97fce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d800a72c3ec04ec584bd08c07ce70523 in term 0.
I20260618 23:23:37.120508 22708 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ad7338762be4a739d7dced5bed6f1d4" candidate_uuid: "d800a72c3ec04ec584bd08c07ce70523" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5710005aa8e40c78b4f359c0f07a426" is_pre_election: true
I20260618 23:23:37.120633 22708 raft_consensus.cc:2454] T 7ad7338762be4a739d7dced5bed6f1d4 P a5710005aa8e40c78b4f359c0f07a426 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d800a72c3ec04ec584bd08c07ce70523 in term 0.
I20260618 23:23:37.120874 22775 leader_election.cc:302] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5710005aa8e40c78b4f359c0f07a426, d800a72c3ec04ec584bd08c07ce70523; no voters:
I20260618 23:23:37.121047 23037 raft_consensus.cc:2781] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:23:37.121121 23037 raft_consensus.cc:482] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:23:37.121152 23037 raft_consensus.cc:3037] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:37.121845 23037 raft_consensus.cc:504] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ea58df5473a4c08bf07c01b06c97fce" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 44997 } } peers { permanent_uuid: "a5710005aa8e40c78b4f359c0f07a426" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 41363 } } peers { permanent_uuid: "d800a72c3ec04ec584bd08c07ce70523" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43631 } }
I20260618 23:23:37.122001 23037 leader_election.cc:288] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523 [CANDIDATE]: Term 1 election: Requested vote from peers 8ea58df5473a4c08bf07c01b06c97fce (127.3.217.131:44997), a5710005aa8e40c78b4f359c0f07a426 (127.3.217.129:41363)
I20260618 23:23:37.122126 22970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ad7338762be4a739d7dced5bed6f1d4" candidate_uuid: "d800a72c3ec04ec584bd08c07ce70523" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ea58df5473a4c08bf07c01b06c97fce"
I20260618 23:23:37.122211 22970 raft_consensus.cc:3037] T 7ad7338762be4a739d7dced5bed6f1d4 P 8ea58df5473a4c08bf07c01b06c97fce [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:37.122247 22708 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ad7338762be4a739d7dced5bed6f1d4" candidate_uuid: "d800a72c3ec04ec584bd08c07ce70523" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5710005aa8e40c78b4f359c0f07a426"
I20260618 23:23:37.122336 22708 raft_consensus.cc:3037] T 7ad7338762be4a739d7dced5bed6f1d4 P a5710005aa8e40c78b4f359c0f07a426 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:37.123034 22970 raft_consensus.cc:2454] T 7ad7338762be4a739d7dced5bed6f1d4 P 8ea58df5473a4c08bf07c01b06c97fce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d800a72c3ec04ec584bd08c07ce70523 in term 1.
I20260618 23:23:37.123207 22774 leader_election.cc:302] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ea58df5473a4c08bf07c01b06c97fce, d800a72c3ec04ec584bd08c07ce70523; no voters:
I20260618 23:23:37.123245 22708 raft_consensus.cc:2454] T 7ad7338762be4a739d7dced5bed6f1d4 P a5710005aa8e40c78b4f359c0f07a426 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d800a72c3ec04ec584bd08c07ce70523 in term 1.
I20260618 23:23:37.123306 23037 raft_consensus.cc:2781] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:37.123461 23037 raft_consensus.cc:686] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523 [term 1 LEADER]: Becoming Leader. State: Replica: d800a72c3ec04ec584bd08c07ce70523, State: Running, Role: LEADER
I20260618 23:23:37.123569 23037 consensus_queue.cc:237] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ea58df5473a4c08bf07c01b06c97fce" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 44997 } } peers { permanent_uuid: "a5710005aa8e40c78b4f359c0f07a426" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 41363 } } peers { permanent_uuid: "d800a72c3ec04ec584bd08c07ce70523" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43631 } }
I20260618 23:23:37.124469 22566 catalog_manager.cc:5495] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523 reported cstate change: term changed from 0 to 1, leader changed from <none> to d800a72c3ec04ec584bd08c07ce70523 (127.3.217.130). New cstate: current_term: 1 leader_uuid: "d800a72c3ec04ec584bd08c07ce70523" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ea58df5473a4c08bf07c01b06c97fce" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 44997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5710005aa8e40c78b4f359c0f07a426" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 41363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d800a72c3ec04ec584bd08c07ce70523" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 43631 } health_report { overall_health: HEALTHY } } }
I20260618 23:23:37.137354 23028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:37.134620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50234 (local address 127.3.217.130:43631)
0618 23:23:37.134769 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:37.134772 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:37.134785 (+ 13us) server_negotiation.cc:407] Connection header received
0618 23:23:37.134911 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:37.134913 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:37.134935 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:37.135003 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:23:37.135171 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.135663 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.136460 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:37.136642 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:37.136705 (+ 63us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:37.136866 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:23:37.136959 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:23:37.137096 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:37.137131 (+ 35us) server_negotiation.cc:299] Negotiation successful
0618 23:23:37.137140 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260618 23:23:37.139664 22708 raft_consensus.cc:1261] T 7ad7338762be4a739d7dced5bed6f1d4 P a5710005aa8e40c78b4f359c0f07a426 [term 1 FOLLOWER]: Refusing update from remote peer d800a72c3ec04ec584bd08c07ce70523: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:23:37.139664 22970 raft_consensus.cc:1261] T 7ad7338762be4a739d7dced5bed6f1d4 P 8ea58df5473a4c08bf07c01b06c97fce [term 1 FOLLOWER]: Refusing update from remote peer d800a72c3ec04ec584bd08c07ce70523: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:23:37.140045 23040 consensus_queue.cc:1035] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5710005aa8e40c78b4f359c0f07a426" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 41363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:23:37.140161 23037 consensus_queue.cc:1035] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ea58df5473a4c08bf07c01b06c97fce" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 44997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:23:37.143316 23044 mvcc.cc:205] Tried to move back new op lower bound from 7298355270201110528 to 7298355270138945536. Current Snapshot: MvccSnapshot[applied={T|T < 7298355270201110528}]
I20260618 23:23:37.144846 22566 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42976:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:23:37.144950 22566 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42976:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:23:37.145670 22566 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3432ce9c8e5f45b698d2c3d7c49a601b: Sending DeleteTablet for 3 replicas of tablet 7ad7338762be4a739d7dced5bed6f1d4
I20260618 23:23:37.145998 22819 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ad7338762be4a739d7dced5bed6f1d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:23:37 UTC) from {username='slave'} at 127.0.0.1:50228
I20260618 23:23:37.146044 22950 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ad7338762be4a739d7dced5bed6f1d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:23:37 UTC) from {username='slave'} at 127.0.0.1:60152
I20260618 23:23:37.146220 23052 tablet_replica.cc:330] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523: stopping tablet replica
I20260618 23:23:37.146235 22685 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ad7338762be4a739d7dced5bed6f1d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:23:37 UTC) from {username='slave'} at 127.0.0.1:38384
I20260618 23:23:37.146324 23052 raft_consensus.cc:2229] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523 [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:23:37.146421 23052 raft_consensus.cc:2258] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:23:37.146427 23054 tablet_replica.cc:330] T 7ad7338762be4a739d7dced5bed6f1d4 P a5710005aa8e40c78b4f359c0f07a426: stopping tablet replica
I20260618 23:23:37.146425 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 22626
I20260618 23:23:37.147957 23052 ts_tablet_manager.cc:1905] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:23:37.150032 23052 ts_tablet_manager.cc:1918] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:23:37.150082 23052 log.cc:1196] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/7ad7338762be4a739d7dced5bed6f1d4
I20260618 23:23:37.150270 23052 ts_tablet_manager.cc:1939] T 7ad7338762be4a739d7dced5bed6f1d4 P d800a72c3ec04ec584bd08c07ce70523: Deleting consensus metadata
I20260618 23:23:37.150630 22551 catalog_manager.cc:4841] TS d800a72c3ec04ec584bd08c07ce70523 (127.3.217.130:43631): tablet 7ad7338762be4a739d7dced5bed6f1d4 (table test-table [id=5d517fc3193a4f269e7ad1f0f2425778]) successfully deleted
I20260618 23:23:37.151445 23053 tablet_replica.cc:330] T 7ad7338762be4a739d7dced5bed6f1d4 P 8ea58df5473a4c08bf07c01b06c97fce: stopping tablet replica
I20260618 23:23:37.151573 23053 raft_consensus.cc:2229] T 7ad7338762be4a739d7dced5bed6f1d4 P 8ea58df5473a4c08bf07c01b06c97fce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:23:37.151677 23053 raft_consensus.cc:2258] T 7ad7338762be4a739d7dced5bed6f1d4 P 8ea58df5473a4c08bf07c01b06c97fce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:23:37.152061 23053 ts_tablet_manager.cc:1905] T 7ad7338762be4a739d7dced5bed6f1d4 P 8ea58df5473a4c08bf07c01b06c97fce: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260618 23:23:37.153297 22553 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.217.129:41363 (error 108)
I20260618 23:23:37.153798 23026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:37.153632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:41363 (local address 127.0.0.1:38386)
0618 23:23:37.153686 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:37.153724 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.129:41363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260618 23:23:37.153834 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 22757
I20260618 23:23:37.153877 23053 ts_tablet_manager.cc:1918] T 7ad7338762be4a739d7dced5bed6f1d4 P 8ea58df5473a4c08bf07c01b06c97fce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:23:37.153939 23053 log.cc:1196] T 7ad7338762be4a739d7dced5bed6f1d4 P 8ea58df5473a4c08bf07c01b06c97fce: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/7ad7338762be4a739d7dced5bed6f1d4
I20260618 23:23:37.154192 23053 ts_tablet_manager.cc:1939] T 7ad7338762be4a739d7dced5bed6f1d4 P 8ea58df5473a4c08bf07c01b06c97fce: Deleting consensus metadata
I20260618 23:23:37.154584 22552 catalog_manager.cc:4841] TS 8ea58df5473a4c08bf07c01b06c97fce (127.3.217.131:44997): tablet 7ad7338762be4a739d7dced5bed6f1d4 (table test-table [id=5d517fc3193a4f269e7ad1f0f2425778]) successfully deleted
W20260618 23:23:37.155572 22553 catalog_manager.cc:4584] TS a5710005aa8e40c78b4f359c0f07a426 (127.3.217.129:41363): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7ad7338762be4a739d7dced5bed6f1d4: Network error: Client connection negotiation failed: client connection to 127.3.217.129:41363: connect: Connection refused (error 111)
I20260618 23:23:37.158870 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 22888
I20260618 23:23:37.163818 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 22535
2026-06-18T23:23:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (706 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:23:37 dist-test-slave-r9ct krb5kdc[23058](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:23:37 dist-test-slave-r9ct krb5kdc[23058](info): set up 2 sockets
Jun 18 23:23:37 dist-test-slave-r9ct krb5kdc[23058](info): commencing operation
krb5kdc: starting...
W20260618 23:23:38.230599 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.047s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:23:38 dist-test-slave-r9ct krb5kdc[23058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:23:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:23:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:23:38.349431 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:34777
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:33033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:34777
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:38.429896 23071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:38.430154 23071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:38.430192 23071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:38.431365 23071 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:23:38.431439 23071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:38.431464 23071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:38.431492 23071 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:23:38.431521 23071 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:23:38.432976 23071 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:33033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:34777
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:34777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:38.433246 23071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:38.433481 23071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:38.438351 23076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:38.438474 23079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:38.438462 23077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:38.438520 23071 server_base.cc:1034] running on GCE node
I20260618 23:23:38.438885 23071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:38.439177 23071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:38.440352 23071 hybrid_clock.cc:648] HybridClock initialized: now 1781825018440368 us; error 84 us; skew 500 ppm
Jun 18 23:23:38 dist-test-slave-r9ct krb5kdc[23058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825018, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:38.443323 23071 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:23:38.443836 23071 webserver.cc:460] Webserver started at http://127.3.217.190:39887/ using document root <none> and password file <none>
I20260618 23:23:38.444072 23071 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:38.444139 23071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:38.444334 23071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:38.445430 23071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "069aa7cd49ae411aa34e84942751b84b"
format_stamp: "Formatted at 2026-06-18 23:23:38 on dist-test-slave-r9ct"
server_key: "61dcfcc97c775b293609d414f3e655ca"
server_key_iv: "9e9c2fa0fa8af80d8d321f38b8c8078d"
server_key_version: "encryptionkey@0"
I20260618 23:23:38.445780 23071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "069aa7cd49ae411aa34e84942751b84b"
format_stamp: "Formatted at 2026-06-18 23:23:38 on dist-test-slave-r9ct"
server_key: "61dcfcc97c775b293609d414f3e655ca"
server_key_iv: "9e9c2fa0fa8af80d8d321f38b8c8078d"
server_key_version: "encryptionkey@0"
I20260618 23:23:38.447175 23071 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:23:38.447949 23086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:38.448128 23071 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260618 23:23:38.448249 23071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "069aa7cd49ae411aa34e84942751b84b"
format_stamp: "Formatted at 2026-06-18 23:23:38 on dist-test-slave-r9ct"
server_key: "61dcfcc97c775b293609d414f3e655ca"
server_key_iv: "9e9c2fa0fa8af80d8d321f38b8c8078d"
server_key_version: "encryptionkey@0"
I20260618 23:23:38.448338 23071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:38.472514 23071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:38.474912 23071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:38.475080 23071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:38.479074 23071 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:34777
I20260618 23:23:38.479111 23138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:34777 every 8 connection(s)
I20260618 23:23:38.479492 23071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:23:38.480326 23139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:38.482681 23139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b: Bootstrap starting.
I20260618 23:23:38.483316 23139 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:38.483603 23139 log.cc:824] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:38.484164 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 23071
I20260618 23:23:38.484279 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:23:38.484428 23139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b: No bootstrap required, opened a new log
I20260618 23:23:38.484485 3942 external_mini_cluster.cc:1428] Setting key 4bf6d6e3565d71031c23fe3ed9cc7fe0
I20260618 23:23:38.486203 23139 raft_consensus.cc:348] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "069aa7cd49ae411aa34e84942751b84b" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34777 } }
I20260618 23:23:38.486330 23139 raft_consensus.cc:374] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:38.486356 23139 raft_consensus.cc:729] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069aa7cd49ae411aa34e84942751b84b, State: Initialized, Role: FOLLOWER
I20260618 23:23:38.486485 23139 consensus_queue.cc:260] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "069aa7cd49ae411aa34e84942751b84b" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34777 } }
I20260618 23:23:38.486569 23139 raft_consensus.cc:388] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:23:38.486616 23139 raft_consensus.cc:482] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:23:38.486665 23139 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:38.487809 23139 raft_consensus.cc:504] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "069aa7cd49ae411aa34e84942751b84b" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34777 } }
I20260618 23:23:38.487905 23139 leader_election.cc:302] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 069aa7cd49ae411aa34e84942751b84b; no voters:
I20260618 23:23:38.488073 23139 leader_election.cc:288] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:23:38.488127 23144 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:38.488260 23144 raft_consensus.cc:686] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b [term 1 LEADER]: Becoming Leader. State: Replica: 069aa7cd49ae411aa34e84942751b84b, State: Running, Role: LEADER
I20260618 23:23:38.488358 23139 sys_catalog.cc:564] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:23:38.488340 23144 consensus_queue.cc:237] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "069aa7cd49ae411aa34e84942751b84b" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34777 } }
I20260618 23:23:38.488677 23144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 069aa7cd49ae411aa34e84942751b84b. Latest consensus state: current_term: 1 leader_uuid: "069aa7cd49ae411aa34e84942751b84b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "069aa7cd49ae411aa34e84942751b84b" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34777 } } }
I20260618 23:23:38.488771 23144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:38.488986 23150 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:23:38.489461 23150 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:23:38.489969 23146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "069aa7cd49ae411aa34e84942751b84b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "069aa7cd49ae411aa34e84942751b84b" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34777 } } }
I20260618 23:23:38.490761 23146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:38.490818 23161 mvcc.cc:205] Tried to move back new op lower bound from 7298355275736342528 to 7298355275728838656. Current Snapshot: MvccSnapshot[applied={T|T < 7298355275736342528}]
I20260618 23:23:38.492326 23150 catalog_manager.cc:1347] Generated new cluster ID: 6999cf1eeef94b488ae0ba900b291eb3
I20260618 23:23:38.492383 23150 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 18 23:23:38 dist-test-slave-r9ct krb5kdc[23058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:23:38.496965 23143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:38.485094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55278 (local address 127.3.217.190:34777)
0618 23:23:38.485328 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:38.485338 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:38.485377 (+ 39us) server_negotiation.cc:407] Connection header received
0618 23:23:38.486202 (+ 825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:38.486209 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:38.486261 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:38.486493 (+ 232us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:38.487394 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:38.488579 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:38.489759 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:38.490399 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:38.490521 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:38.492974 (+ 2453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:38.492978 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:38.492978 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:38.492990 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:38.494980 (+ 1990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:38.495668 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:38.495673 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:38.495674 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:38.495841 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:38.496058 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:38.496059 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:38.496060 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:38.496364 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:38.496524 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:38.496602 (+ 78us) server_negotiation.cc:299] Negotiation successful
0618 23:23:38.496744 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":77,"threads_started":1}
I20260618 23:23:38.507606 23150 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:23:38.508306 23150 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:23:38.513473 23150 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b: Generated new TSK 0
I20260618 23:23:38.513636 23150 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.217.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
Entry for principal kudu/127.3.217.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab.
I20260618 23:23:38.542759 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34777
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:33033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:38.625129 23165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:38.625329 23165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:38.625352 23165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:38.626505 23165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:38.626551 23165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:38.626577 23165 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:23:38.628145 23165 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:33033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.129.keytab
--principal=kudu/127.3.217.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:38.628369 23165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:38.628612 23165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:38.633778 23173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:38.633881 23171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:38.634028 23170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:38.634087 23165 server_base.cc:1034] running on GCE node
I20260618 23:23:38.634305 23165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:38.634552 23165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:38.635716 23165 hybrid_clock.cc:648] HybridClock initialized: now 1781825018635681 us; error 48 us; skew 500 ppm
Jun 18 23:23:38 dist-test-slave-r9ct krb5kdc[23058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825018, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:38.638300 23165 init.cc:377] Logged in from keytab as kudu/127.3.217.129@KRBTEST.COM (short username kudu)
I20260618 23:23:38.638816 23165 webserver.cc:460] Webserver started at http://127.3.217.129:42147/ using document root <none> and password file <none>
I20260618 23:23:38.638996 23165 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:38.639036 23165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:38.639122 23165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:38.640105 23165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "4245836c91cf4413a2419b149d792e22"
format_stamp: "Formatted at 2026-06-18 23:23:38 on dist-test-slave-r9ct"
server_key: "610905161f1a80472dd940cadff9fedd"
server_key_iv: "a4f56a085ea523ac9c9f14cf7fcefa53"
server_key_version: "encryptionkey@0"
I20260618 23:23:38.640406 23165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "4245836c91cf4413a2419b149d792e22"
format_stamp: "Formatted at 2026-06-18 23:23:38 on dist-test-slave-r9ct"
server_key: "610905161f1a80472dd940cadff9fedd"
server_key_iv: "a4f56a085ea523ac9c9f14cf7fcefa53"
server_key_version: "encryptionkey@0"
I20260618 23:23:38.641606 23165 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:23:38.642362 23180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:38.642603 23165 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:38.642705 23165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "4245836c91cf4413a2419b149d792e22"
format_stamp: "Formatted at 2026-06-18 23:23:38 on dist-test-slave-r9ct"
server_key: "610905161f1a80472dd940cadff9fedd"
server_key_iv: "a4f56a085ea523ac9c9f14cf7fcefa53"
server_key_version: "encryptionkey@0"
I20260618 23:23:38.642812 23165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:38.669971 23165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:38.672694 23165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:38.672863 23165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:38.673120 23165 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:23:38.673740 23165 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:23:38.673872 23165 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:38.673913 23165 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:23:38.673944 23165 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:38.681510 23165 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:45317
I20260618 23:23:38.681677 23293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:45317 every 8 connection(s)
I20260618 23:23:38.681968 23165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:23:38.687853 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 23165
I20260618 23:23:38.688120 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:23:38.688603 3942 external_mini_cluster.cc:1428] Setting key 4b232f3c3530aa6d07f36ae0f5d3d4f7
Jun 18 23:23:38 dist-test-slave-r9ct krb5kdc[23058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825018, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.129@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:23:38.692658 23143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:38.682811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:34011 (local address 127.3.217.190:34777)
0618 23:23:38.682855 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:38.682857 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:38.683133 (+ 276us) server_negotiation.cc:407] Connection header received
0618 23:23:38.683598 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:38.683599 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:38.683612 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:38.683672 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:38.684704 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:38.685273 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:38.686412 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:38.686645 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:38.686797 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:38.689546 (+ 2749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:38.689548 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:38.689548 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:38.689556 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:38.691225 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:38.691674 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:38.691675 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:38.691676 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:38.691736 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:38.691992 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:38.691993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:38.691993 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:38.692113 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:38.692208 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:38.692479 (+ 271us) server_negotiation.cc:299] Negotiation successful
0618 23:23:38.692566 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260618 23:23:38.692862 23296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:38.682833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:34777 (local address 127.3.217.129:34011)
0618 23:23:38.682997 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:38.683033 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:38.683498 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:38.683730 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:38.683733 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:38.684363 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:23:38.684553 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:38.684557 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:38.685423 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:38.685424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:38.686300 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:38.686302 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:38.686837 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:38.686838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:38.686958 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:38.687556 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:23:38.687564 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:23:38.689432 (+ 1868us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:23:38.691350 (+ 1918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:23:38.691357 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:23:38.691360 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:23:38.691584 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:23:38.691805 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:23:38.691806 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:23:38.691807 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:23:38.691921 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:23:38.692201 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:23:38.692207 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:23:38.692346 (+ 139us) client_negotiation.cc:769] Sending connection context
0618 23:23:38.692456 (+ 110us) client_negotiation.cc:240] Negotiation successful
0618 23:23:38.692610 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":69,"threads_started":1}
I20260618 23:23:38.693359 23294 heartbeater.cc:347] Connected to a master server at 127.3.217.190:34777
I20260618 23:23:38.693452 23294 heartbeater.cc:464] Registering TS with master...
I20260618 23:23:38.693637 23294 heartbeater.cc:511] Master 127.3.217.190:34777 requested a full tablet report, sending...
I20260618 23:23:38.694154 23103 ts_manager.cc:194] Registered new tserver with Master: 4245836c91cf4413a2419b149d792e22 (127.3.217.129:45317)
I20260618 23:23:38.694828 23103 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.129@KRBTEST.COM'} at 127.3.217.129:34011
WARNING: no policy specified for kudu/127.3.217.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
Entry for principal kudu/127.3.217.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab.
I20260618 23:23:38.718922 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34777
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:33033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:38.799512 23299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:38.799717 23299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:38.799739 23299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:38.800798 23299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:38.800832 23299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:38.800858 23299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:23:38.802208 23299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:33033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.130.keytab
--principal=kudu/127.3.217.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23299
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:38.802394 23299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:38.802561 23299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:38.807585 23304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:38.807574 23305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:38.807576 23307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:38.807788 23299 server_base.cc:1034] running on GCE node
I20260618 23:23:38.808020 23299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:38.808321 23299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:38.809487 23299 hybrid_clock.cc:648] HybridClock initialized: now 1781825018809468 us; error 34 us; skew 500 ppm
Jun 18 23:23:38 dist-test-slave-r9ct krb5kdc[23058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825018, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:38.812387 23299 init.cc:377] Logged in from keytab as kudu/127.3.217.130@KRBTEST.COM (short username kudu)
I20260618 23:23:38.812858 23299 webserver.cc:460] Webserver started at http://127.3.217.130:38793/ using document root <none> and password file <none>
I20260618 23:23:38.813113 23299 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:38.813205 23299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:38.813378 23299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:38.814491 23299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "ca0e3d36b9a642998ddf7d000f9685e6"
format_stamp: "Formatted at 2026-06-18 23:23:38 on dist-test-slave-r9ct"
server_key: "27ea2bad590d445c0d694e1f754e0bfb"
server_key_iv: "d700c9cf9b908091762f0acadc5007c6"
server_key_version: "encryptionkey@0"
I20260618 23:23:38.814901 23299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "ca0e3d36b9a642998ddf7d000f9685e6"
format_stamp: "Formatted at 2026-06-18 23:23:38 on dist-test-slave-r9ct"
server_key: "27ea2bad590d445c0d694e1f754e0bfb"
server_key_iv: "d700c9cf9b908091762f0acadc5007c6"
server_key_version: "encryptionkey@0"
I20260618 23:23:38.816429 23299 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:23:38.817477 23314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:38.817685 23299 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:23:38.817778 23299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "ca0e3d36b9a642998ddf7d000f9685e6"
format_stamp: "Formatted at 2026-06-18 23:23:38 on dist-test-slave-r9ct"
server_key: "27ea2bad590d445c0d694e1f754e0bfb"
server_key_iv: "d700c9cf9b908091762f0acadc5007c6"
server_key_version: "encryptionkey@0"
I20260618 23:23:38.817826 23299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:38.841898 23299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:38.844270 23299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:38.844429 23299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:38.844664 23299 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:23:38.844969 23299 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:23:38.845008 23299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:38.845029 23299 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:23:38.845077 23299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:38.851274 23299 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:46089
I20260618 23:23:38.851329 23427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:46089 every 8 connection(s)
I20260618 23:23:38.851691 23299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:23:38.853838 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 23299
I20260618 23:23:38.853955 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:23:38.854173 3942 external_mini_cluster.cc:1428] Setting key 0dc0018773276e76274364355f6421d1
Jun 18 23:23:38 dist-test-slave-r9ct krb5kdc[23058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825018, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.130@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:23:38.862820 23143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:38.852436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:41521 (local address 127.3.217.190:34777)
0618 23:23:38.852524 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:38.852526 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:38.852698 (+ 172us) server_negotiation.cc:407] Connection header received
0618 23:23:38.853139 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:38.853140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:38.853148 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:38.853207 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:38.854392 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:38.855146 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:38.856985 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:38.857301 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:38.857381 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:38.859647 (+ 2266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:38.859649 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:38.859649 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:38.859657 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:38.861385 (+ 1728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:38.861780 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:38.861781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:38.861781 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:38.861851 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:38.862124 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:38.862125 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:38.862126 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:38.862261 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:38.862337 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:38.862582 (+ 245us) server_negotiation.cc:299] Negotiation successful
0618 23:23:38.862670 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260618 23:23:38.862951 23430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:38.852382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:34777 (local address 127.3.217.130:41521)
0618 23:23:38.852553 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:38.852595 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:38.853058 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:38.853255 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:38.853258 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:38.853961 (+ 703us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:23:38.854237 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:38.854244 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:38.855324 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:38.855327 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:38.856871 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:38.856886 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:38.857402 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:38.857403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:38.857511 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:38.858057 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:23:38.858064 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:23:38.859553 (+ 1489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:23:38.861474 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:23:38.861480 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:23:38.861481 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:23:38.861702 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:23:38.861942 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:23:38.861943 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:23:38.861944 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:23:38.862047 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:23:38.862334 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:23:38.862339 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:23:38.862449 (+ 110us) client_negotiation.cc:769] Sending connection context
0618 23:23:38.862535 (+ 86us) client_negotiation.cc:240] Negotiation successful
0618 23:23:38.862663 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":101,"threads_started":1}
WARNING: no policy specified for kudu/127.3.217.131@KRBTEST.COM; defaulting to no policy
I20260618 23:23:38.863584 23428 heartbeater.cc:347] Connected to a master server at 127.3.217.190:34777
I20260618 23:23:38.863685 23428 heartbeater.cc:464] Registering TS with master...
I20260618 23:23:38.863868 23428 heartbeater.cc:511] Master 127.3.217.190:34777 requested a full tablet report, sending...
I20260618 23:23:38.864248 23103 ts_manager.cc:194] Registered new tserver with Master: ca0e3d36b9a642998ddf7d000f9685e6 (127.3.217.130:46089)
I20260618 23:23:38.864740 23103 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.130@KRBTEST.COM'} at 127.3.217.130:41521
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
Entry for principal kudu/127.3.217.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab.
I20260618 23:23:38.883036 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34777
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:33033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:38.961621 23433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:38.961833 23433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:38.961856 23433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:38.962963 23433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:38.963011 23433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:38.963057 23433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:23:38.964483 23433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:33033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.131.keytab
--principal=kudu/127.3.217.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:34777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:38.964738 23433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:38.964983 23433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:38.970160 23438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:38.970085 23439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:38.970162 23441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:38.970472 23433 server_base.cc:1034] running on GCE node
I20260618 23:23:38.970789 23433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:38.971024 23433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:38.972196 23433 hybrid_clock.cc:648] HybridClock initialized: now 1781825018972142 us; error 75 us; skew 500 ppm
Jun 18 23:23:38 dist-test-slave-r9ct krb5kdc[23058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825018, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:38.975363 23433 init.cc:377] Logged in from keytab as kudu/127.3.217.131@KRBTEST.COM (short username kudu)
I20260618 23:23:38.975883 23433 webserver.cc:460] Webserver started at http://127.3.217.131:37453/ using document root <none> and password file <none>
I20260618 23:23:38.976219 23433 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:38.976300 23433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:38.976444 23433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:38.977640 23433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "92c07022fdba4e57992f3e978e11bea0"
format_stamp: "Formatted at 2026-06-18 23:23:38 on dist-test-slave-r9ct"
server_key: "b22c8d2952f6dc8ea83841175cee5da0"
server_key_iv: "ac65be0f87ca9006340858e092536933"
server_key_version: "encryptionkey@0"
I20260618 23:23:38.978024 23433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "92c07022fdba4e57992f3e978e11bea0"
format_stamp: "Formatted at 2026-06-18 23:23:38 on dist-test-slave-r9ct"
server_key: "b22c8d2952f6dc8ea83841175cee5da0"
server_key_iv: "ac65be0f87ca9006340858e092536933"
server_key_version: "encryptionkey@0"
I20260618 23:23:38.979544 23433 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260618 23:23:38.980355 23448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:38.980656 23433 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:23:38.980810 23433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "92c07022fdba4e57992f3e978e11bea0"
format_stamp: "Formatted at 2026-06-18 23:23:38 on dist-test-slave-r9ct"
server_key: "b22c8d2952f6dc8ea83841175cee5da0"
server_key_iv: "ac65be0f87ca9006340858e092536933"
server_key_version: "encryptionkey@0"
I20260618 23:23:38.980914 23433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:39.000594 23433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:39.003014 23433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:39.003172 23433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:39.003412 23433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:23:39.003715 23433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:23:39.003769 23433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:39.003804 23433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:23:39.003851 23433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:39.010320 23433 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:46527
I20260618 23:23:39.010391 23561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:46527 every 8 connection(s)
I20260618 23:23:39.010799 23433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:23:39.018266 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 23433
I20260618 23:23:39.018363 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
Jun 18 23:23:39 dist-test-slave-r9ct krb5kdc[23058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825018, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.131@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:23:39.018584 3942 external_mini_cluster.cc:1428] Setting key 9806a70378dcf6a482126b3d76c4778a
I20260618 23:23:39.022027 23143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.011728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:49109 (local address 127.3.217.190:34777)
0618 23:23:39.011934 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:39.011937 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:39.012133 (+ 196us) server_negotiation.cc:407] Connection header received
0618 23:23:39.013112 (+ 979us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:39.013114 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:39.013128 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:39.013177 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:39.014348 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.015071 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.016156 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.016347 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.016420 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.019064 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:39.019066 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:39.019066 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:39.019075 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:39.020573 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:39.021028 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:39.021029 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:39.021030 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:39.021109 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:39.021387 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:39.021388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:39.021389 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:39.021506 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:39.021583 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:39.021851 (+ 268us) server_negotiation.cc:299] Negotiation successful
0618 23:23:39.021932 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260618 23:23:39.022229 23564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.011587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:34777 (local address 127.3.217.131:49109)
0618 23:23:39.011944 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:39.012007 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:39.012949 (+ 942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:39.013259 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:39.013263 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:39.014033 (+ 770us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:23:39.014244 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.014249 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.015175 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.015176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.016057 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.016059 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.016426 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.016427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.016559 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.017103 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:23:39.017113 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:23:39.018965 (+ 1852us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:23:39.020708 (+ 1743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:23:39.020714 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:23:39.020717 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:23:39.020945 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:23:39.021191 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:23:39.021192 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:23:39.021192 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:23:39.021312 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:23:39.021572 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:23:39.021578 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:23:39.021717 (+ 139us) client_negotiation.cc:769] Sending connection context
0618 23:23:39.021828 (+ 111us) client_negotiation.cc:240] Negotiation successful
0618 23:23:39.021991 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":128,"threads_started":1}
I20260618 23:23:39.022778 23562 heartbeater.cc:347] Connected to a master server at 127.3.217.190:34777
I20260618 23:23:39.022912 23562 heartbeater.cc:464] Registering TS with master...
I20260618 23:23:39.023108 23562 heartbeater.cc:511] Master 127.3.217.190:34777 requested a full tablet report, sending...
I20260618 23:23:39.023500 23103 ts_manager.cc:194] Registered new tserver with Master: 92c07022fdba4e57992f3e978e11bea0 (127.3.217.131:46527)
I20260618 23:23:39.023891 23103 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.217.131@KRBTEST.COM'} at 127.3.217.131:49109
I20260618 23:23:39.031132 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260618 23:23:39.038769 23143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.032529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55290 (local address 127.3.217.190:34777)
0618 23:23:39.032618 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:39.032620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:39.032702 (+ 82us) server_negotiation.cc:407] Connection header received
0618 23:23:39.032780 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:39.032781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:39.032793 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:39.032850 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:39.033403 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.033881 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.034660 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.034915 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.034999 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.036210 (+ 1211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:39.036211 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:39.036212 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:39.036219 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:39.037579 (+ 1360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:39.037940 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:39.037941 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:39.037941 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:39.037998 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:39.038195 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:39.038196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:39.038196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:39.038346 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:39.038452 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:39.038570 (+ 118us) server_negotiation.cc:299] Negotiation successful
0618 23:23:39.038644 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260618 23:23:39.040390 23103 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55290:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:23:39.041882 23103 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:23:39.049069 23575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.044709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49956 (local address 127.3.217.129:45317)
0618 23:23:39.044910 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:39.044915 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:39.044924 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:23:39.044959 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:39.044961 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:39.044976 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:39.045068 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:39.045313 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.046516 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.048070 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.048735 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.048797 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.048842 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:39.048950 (+ 108us) server_negotiation.cc:299] Negotiation successful
0618 23:23:39.048988 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":93,"threads_started":1}
I20260618 23:23:39.049098 23576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.044767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:46527 (local address 127.0.0.1:40570)
0618 23:23:39.045188 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:39.045198 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:39.045260 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:39.045564 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:39.045565 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:39.045567 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:39.045599 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.045600 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.046910 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.046911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.047840 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.047842 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.048743 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.048744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.048835 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.048850 (+ 15us) client_negotiation.cc:769] Sending connection context
0618 23:23:39.048928 (+ 78us) client_negotiation.cc:240] Negotiation successful
0618 23:23:39.048995 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":403,"mutex_wait_us":32,"thread_start_us":57,"threads_started":1}
I20260618 23:23:39.049304 23578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.044949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40570 (local address 127.3.217.131:46527)
0618 23:23:39.045117 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:39.045121 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:39.045368 (+ 247us) server_negotiation.cc:407] Connection header received
0618 23:23:39.045411 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:39.045413 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:39.045428 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:39.045496 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:39.045683 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.046820 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.047931 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.048658 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.048738 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.048798 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:39.049190 (+ 392us) server_negotiation.cc:299] Negotiation successful
0618 23:23:39.049229 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":73,"threads_started":1}
I20260618 23:23:39.049101 23574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.044581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:45317 (local address 127.0.0.1:49956)
0618 23:23:39.044731 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:39.044773 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:39.044841 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:39.045145 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:39.045147 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:39.045149 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:39.045229 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.045230 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.046603 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.046604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.047987 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.047989 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.048821 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.048822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.048870 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.048873 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:23:39.048928 (+ 55us) client_negotiation.cc:240] Negotiation successful
0618 23:23:39.048995 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":109,"thread_start_us":54,"threads_started":1}
I20260618 23:23:39.049993 23573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.044593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:46089 (local address 127.0.0.1:47936)
0618 23:23:39.044963 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:39.044975 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:39.045030 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:39.045409 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:39.045410 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:39.045412 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:39.045458 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.045459 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.046530 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.046531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.047985 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.047988 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.049765 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.049766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.049829 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.049833 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:23:39.049888 (+ 55us) client_negotiation.cc:240] Negotiation successful
0618 23:23:39.049925 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"mutex_wait_us":67,"thread_start_us":77,"threads_started":1}
I20260618 23:23:39.050061 23577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.044772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47936 (local address 127.3.217.130:46089)
0618 23:23:39.045186 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:39.045191 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:39.045201 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:23:39.045240 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:39.045242 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:39.045258 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:39.045330 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:39.045534 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.046440 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.048876 (+ 2436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.049607 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.049680 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.049734 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:39.049920 (+ 186us) server_negotiation.cc:299] Negotiation successful
0618 23:23:39.049967 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":111,"threads_started":1}
I20260618 23:23:39.050019 23496 tablet_service.cc:1467] Processing CreateTablet for tablet 7320e726f48f4fc09bf2db2e3d7cf928 (DEFAULT_TABLE table=test-table [id=f8780d9c92ee45e1bda2113c5bd5f780]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:23:39.050163 23228 tablet_service.cc:1467] Processing CreateTablet for tablet 7320e726f48f4fc09bf2db2e3d7cf928 (DEFAULT_TABLE table=test-table [id=f8780d9c92ee45e1bda2113c5bd5f780]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:23:39.050417 23228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7320e726f48f4fc09bf2db2e3d7cf928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:39.050428 23496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7320e726f48f4fc09bf2db2e3d7cf928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:39.050601 23362 tablet_service.cc:1467] Processing CreateTablet for tablet 7320e726f48f4fc09bf2db2e3d7cf928 (DEFAULT_TABLE table=test-table [id=f8780d9c92ee45e1bda2113c5bd5f780]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:23:39.050967 23362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7320e726f48f4fc09bf2db2e3d7cf928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:39.053128 23579 tablet_bootstrap.cc:492] T 7320e726f48f4fc09bf2db2e3d7cf928 P 4245836c91cf4413a2419b149d792e22: Bootstrap starting.
I20260618 23:23:39.053627 23580 tablet_bootstrap.cc:492] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0: Bootstrap starting.
I20260618 23:23:39.053711 23579 tablet_bootstrap.cc:654] T 7320e726f48f4fc09bf2db2e3d7cf928 P 4245836c91cf4413a2419b149d792e22: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:39.054270 23580 tablet_bootstrap.cc:654] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:39.054291 23579 log.cc:824] T 7320e726f48f4fc09bf2db2e3d7cf928 P 4245836c91cf4413a2419b149d792e22: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:39.054404 23581 tablet_bootstrap.cc:492] T 7320e726f48f4fc09bf2db2e3d7cf928 P ca0e3d36b9a642998ddf7d000f9685e6: Bootstrap starting.
I20260618 23:23:39.054852 23580 log.cc:824] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:39.055065 23581 tablet_bootstrap.cc:654] T 7320e726f48f4fc09bf2db2e3d7cf928 P ca0e3d36b9a642998ddf7d000f9685e6: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:39.055084 23579 tablet_bootstrap.cc:492] T 7320e726f48f4fc09bf2db2e3d7cf928 P 4245836c91cf4413a2419b149d792e22: No bootstrap required, opened a new log
I20260618 23:23:39.055140 23579 ts_tablet_manager.cc:1397] T 7320e726f48f4fc09bf2db2e3d7cf928 P 4245836c91cf4413a2419b149d792e22: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:23:39.055536 23580 tablet_bootstrap.cc:492] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0: No bootstrap required, opened a new log
I20260618 23:23:39.055567 23581 log.cc:824] T 7320e726f48f4fc09bf2db2e3d7cf928 P ca0e3d36b9a642998ddf7d000f9685e6: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:39.055665 23580 ts_tablet_manager.cc:1397] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:23:39.056206 23581 tablet_bootstrap.cc:492] T 7320e726f48f4fc09bf2db2e3d7cf928 P ca0e3d36b9a642998ddf7d000f9685e6: No bootstrap required, opened a new log
I20260618 23:23:39.056294 23581 ts_tablet_manager.cc:1397] T 7320e726f48f4fc09bf2db2e3d7cf928 P ca0e3d36b9a642998ddf7d000f9685e6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:23:39.057294 23579 raft_consensus.cc:348] T 7320e726f48f4fc09bf2db2e3d7cf928 P 4245836c91cf4413a2419b149d792e22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4245836c91cf4413a2419b149d792e22" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45317 } } peers { permanent_uuid: "92c07022fdba4e57992f3e978e11bea0" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46527 } } peers { permanent_uuid: "ca0e3d36b9a642998ddf7d000f9685e6" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 46089 } }
I20260618 23:23:39.057475 23579 raft_consensus.cc:374] T 7320e726f48f4fc09bf2db2e3d7cf928 P 4245836c91cf4413a2419b149d792e22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:39.057513 23579 raft_consensus.cc:729] T 7320e726f48f4fc09bf2db2e3d7cf928 P 4245836c91cf4413a2419b149d792e22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4245836c91cf4413a2419b149d792e22, State: Initialized, Role: FOLLOWER
I20260618 23:23:39.057541 23580 raft_consensus.cc:348] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4245836c91cf4413a2419b149d792e22" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45317 } } peers { permanent_uuid: "92c07022fdba4e57992f3e978e11bea0" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46527 } } peers { permanent_uuid: "ca0e3d36b9a642998ddf7d000f9685e6" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 46089 } }
I20260618 23:23:39.057686 23580 raft_consensus.cc:374] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:39.057662 23579 consensus_queue.cc:260] T 7320e726f48f4fc09bf2db2e3d7cf928 P 4245836c91cf4413a2419b149d792e22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4245836c91cf4413a2419b149d792e22" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45317 } } peers { permanent_uuid: "92c07022fdba4e57992f3e978e11bea0" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46527 } } peers { permanent_uuid: "ca0e3d36b9a642998ddf7d000f9685e6" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 46089 } }
I20260618 23:23:39.057719 23580 raft_consensus.cc:729] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92c07022fdba4e57992f3e978e11bea0, State: Initialized, Role: FOLLOWER
I20260618 23:23:39.057629 23581 raft_consensus.cc:348] T 7320e726f48f4fc09bf2db2e3d7cf928 P ca0e3d36b9a642998ddf7d000f9685e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4245836c91cf4413a2419b149d792e22" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45317 } } peers { permanent_uuid: "92c07022fdba4e57992f3e978e11bea0" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46527 } } peers { permanent_uuid: "ca0e3d36b9a642998ddf7d000f9685e6" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 46089 } }
I20260618 23:23:39.057817 23581 raft_consensus.cc:374] T 7320e726f48f4fc09bf2db2e3d7cf928 P ca0e3d36b9a642998ddf7d000f9685e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:39.057817 23580 consensus_queue.cc:260] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4245836c91cf4413a2419b149d792e22" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45317 } } peers { permanent_uuid: "92c07022fdba4e57992f3e978e11bea0" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46527 } } peers { permanent_uuid: "ca0e3d36b9a642998ddf7d000f9685e6" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 46089 } }
I20260618 23:23:39.057855 23581 raft_consensus.cc:729] T 7320e726f48f4fc09bf2db2e3d7cf928 P ca0e3d36b9a642998ddf7d000f9685e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca0e3d36b9a642998ddf7d000f9685e6, State: Initialized, Role: FOLLOWER
I20260618 23:23:39.057926 23579 ts_tablet_manager.cc:1428] T 7320e726f48f4fc09bf2db2e3d7cf928 P 4245836c91cf4413a2419b149d792e22: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260618 23:23:39.057981 23581 consensus_queue.cc:260] T 7320e726f48f4fc09bf2db2e3d7cf928 P ca0e3d36b9a642998ddf7d000f9685e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4245836c91cf4413a2419b149d792e22" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45317 } } peers { permanent_uuid: "92c07022fdba4e57992f3e978e11bea0" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46527 } } peers { permanent_uuid: "ca0e3d36b9a642998ddf7d000f9685e6" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 46089 } }
I20260618 23:23:39.058048 23294 heartbeater.cc:503] Master 127.3.217.190:34777 was elected leader, sending a full tablet report...
I20260618 23:23:39.058200 23562 heartbeater.cc:503] Master 127.3.217.190:34777 was elected leader, sending a full tablet report...
I20260618 23:23:39.058270 23581 ts_tablet_manager.cc:1428] T 7320e726f48f4fc09bf2db2e3d7cf928 P ca0e3d36b9a642998ddf7d000f9685e6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:23:39.058399 23428 heartbeater.cc:503] Master 127.3.217.190:34777 was elected leader, sending a full tablet report...
I20260618 23:23:39.058439 23580 ts_tablet_manager.cc:1428] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260618 23:23:39.064134 23586 raft_consensus.cc:482] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:23:39.064218 23586 raft_consensus.cc:504] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4245836c91cf4413a2419b149d792e22" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45317 } } peers { permanent_uuid: "92c07022fdba4e57992f3e978e11bea0" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46527 } } peers { permanent_uuid: "ca0e3d36b9a642998ddf7d000f9685e6" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 46089 } }
I20260618 23:23:39.064527 23586 leader_election.cc:288] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4245836c91cf4413a2419b149d792e22 (127.3.217.129:45317), ca0e3d36b9a642998ddf7d000f9685e6 (127.3.217.130:46089)
I20260618 23:23:39.067868 23575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.064720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:45029 (local address 127.3.217.129:45317)
0618 23:23:39.064763 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:39.064765 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:39.064775 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:23:39.064845 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:39.064846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:39.064856 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:39.064928 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:39.065124 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.065798 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.066997 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.067522 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.067574 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.067581 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:39.067770 (+ 189us) server_negotiation.cc:299] Negotiation successful
0618 23:23:39.067823 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260618 23:23:39.067863 23564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.064646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:45317 (local address 127.3.217.131:45029)
0618 23:23:39.064705 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:39.064720 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:39.064778 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:39.064956 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:39.064956 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:39.064958 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:39.065052 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.065054 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.065875 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.065876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.066924 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.066926 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.067594 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.067595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.067679 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.067682 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:23:39.067746 (+ 64us) client_negotiation.cc:240] Negotiation successful
0618 23:23:39.067787 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260618 23:23:39.068230 23248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7320e726f48f4fc09bf2db2e3d7cf928" candidate_uuid: "92c07022fdba4e57992f3e978e11bea0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4245836c91cf4413a2419b149d792e22" is_pre_election: true
I20260618 23:23:39.068332 23588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.064701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:46089 (local address 127.3.217.131:48131)
0618 23:23:39.064880 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:39.064890 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:39.064942 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:39.065124 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:39.065125 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:39.065126 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:39.065191 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.065192 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.066359 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.066360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.067307 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.067309 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.068077 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.068078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.068157 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.068161 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:23:39.068219 (+ 58us) client_negotiation.cc:240] Negotiation successful
0618 23:23:39.068262 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":108,"threads_started":1}
I20260618 23:23:39.068327 23577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.064776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:48131 (local address 127.3.217.130:46089)
0618 23:23:39.064814 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:39.064816 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:39.064933 (+ 117us) server_negotiation.cc:407] Connection header received
0618 23:23:39.065016 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:39.065017 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:39.065030 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:39.065093 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:39.065447 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.066271 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.067390 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.067957 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.068034 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.068042 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:39.068239 (+ 197us) server_negotiation.cc:299] Negotiation successful
0618 23:23:39.068272 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260618 23:23:39.068389 23248 raft_consensus.cc:2454] T 7320e726f48f4fc09bf2db2e3d7cf928 P 4245836c91cf4413a2419b149d792e22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92c07022fdba4e57992f3e978e11bea0 in term 0.
I20260618 23:23:39.068608 23450 leader_election.cc:302] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4245836c91cf4413a2419b149d792e22, 92c07022fdba4e57992f3e978e11bea0; no voters:
I20260618 23:23:39.068657 23382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7320e726f48f4fc09bf2db2e3d7cf928" candidate_uuid: "92c07022fdba4e57992f3e978e11bea0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca0e3d36b9a642998ddf7d000f9685e6" is_pre_election: true
I20260618 23:23:39.068759 23586 raft_consensus.cc:2781] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:23:39.068787 23382 raft_consensus.cc:2454] T 7320e726f48f4fc09bf2db2e3d7cf928 P ca0e3d36b9a642998ddf7d000f9685e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92c07022fdba4e57992f3e978e11bea0 in term 0.
I20260618 23:23:39.068835 23586 raft_consensus.cc:482] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:23:39.068872 23586 raft_consensus.cc:3037] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:39.069576 23586 raft_consensus.cc:504] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4245836c91cf4413a2419b149d792e22" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45317 } } peers { permanent_uuid: "92c07022fdba4e57992f3e978e11bea0" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46527 } } peers { permanent_uuid: "ca0e3d36b9a642998ddf7d000f9685e6" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 46089 } }
I20260618 23:23:39.069721 23586 leader_election.cc:288] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0 [CANDIDATE]: Term 1 election: Requested vote from peers 4245836c91cf4413a2419b149d792e22 (127.3.217.129:45317), ca0e3d36b9a642998ddf7d000f9685e6 (127.3.217.130:46089)
I20260618 23:23:39.069887 23382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7320e726f48f4fc09bf2db2e3d7cf928" candidate_uuid: "92c07022fdba4e57992f3e978e11bea0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca0e3d36b9a642998ddf7d000f9685e6"
I20260618 23:23:39.069897 23248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7320e726f48f4fc09bf2db2e3d7cf928" candidate_uuid: "92c07022fdba4e57992f3e978e11bea0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4245836c91cf4413a2419b149d792e22"
I20260618 23:23:39.069969 23382 raft_consensus.cc:3037] T 7320e726f48f4fc09bf2db2e3d7cf928 P ca0e3d36b9a642998ddf7d000f9685e6 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:39.069988 23248 raft_consensus.cc:3037] T 7320e726f48f4fc09bf2db2e3d7cf928 P 4245836c91cf4413a2419b149d792e22 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:39.070631 23382 raft_consensus.cc:2454] T 7320e726f48f4fc09bf2db2e3d7cf928 P ca0e3d36b9a642998ddf7d000f9685e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92c07022fdba4e57992f3e978e11bea0 in term 1.
I20260618 23:23:39.070713 23248 raft_consensus.cc:2454] T 7320e726f48f4fc09bf2db2e3d7cf928 P 4245836c91cf4413a2419b149d792e22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92c07022fdba4e57992f3e978e11bea0 in term 1.
I20260618 23:23:39.070855 23449 leader_election.cc:302] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92c07022fdba4e57992f3e978e11bea0, ca0e3d36b9a642998ddf7d000f9685e6; no voters:
I20260618 23:23:39.070937 23586 raft_consensus.cc:2781] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:39.071067 23586 raft_consensus.cc:686] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0 [term 1 LEADER]: Becoming Leader. State: Replica: 92c07022fdba4e57992f3e978e11bea0, State: Running, Role: LEADER
I20260618 23:23:39.071163 23586 consensus_queue.cc:237] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4245836c91cf4413a2419b149d792e22" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45317 } } peers { permanent_uuid: "92c07022fdba4e57992f3e978e11bea0" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46527 } } peers { permanent_uuid: "ca0e3d36b9a642998ddf7d000f9685e6" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 46089 } }
I20260618 23:23:39.071967 23103 catalog_manager.cc:5495] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92c07022fdba4e57992f3e978e11bea0 (127.3.217.131). New cstate: current_term: 1 leader_uuid: "92c07022fdba4e57992f3e978e11bea0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4245836c91cf4413a2419b149d792e22" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92c07022fdba4e57992f3e978e11bea0" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca0e3d36b9a642998ddf7d000f9685e6" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 46089 } health_report { overall_health: UNKNOWN } } }
I20260618 23:23:39.084544 23578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.081806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40584 (local address 127.3.217.131:46527)
0618 23:23:39.081869 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:39.081871 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:39.081878 (+ 7us) server_negotiation.cc:407] Connection header received
0618 23:23:39.081912 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:39.081913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:39.081930 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:39.082001 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:23:39.082156 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.082761 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.083615 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.083969 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.084033 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.084244 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:23:39.084347 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:23:39.084408 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:39.084454 (+ 46us) server_negotiation.cc:299] Negotiation successful
0618 23:23:39.084472 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260618 23:23:39.086395 23382 raft_consensus.cc:1261] T 7320e726f48f4fc09bf2db2e3d7cf928 P ca0e3d36b9a642998ddf7d000f9685e6 [term 1 FOLLOWER]: Refusing update from remote peer 92c07022fdba4e57992f3e978e11bea0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:23:39.086503 23248 raft_consensus.cc:1261] T 7320e726f48f4fc09bf2db2e3d7cf928 P 4245836c91cf4413a2419b149d792e22 [term 1 FOLLOWER]: Refusing update from remote peer 92c07022fdba4e57992f3e978e11bea0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:23:39.086843 23589 consensus_queue.cc:1035] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca0e3d36b9a642998ddf7d000f9685e6" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 46089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:23:39.086990 23586 consensus_queue.cc:1035] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4245836c91cf4413a2419b149d792e22" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:23:39.089435 23592 mvcc.cc:205] Tried to move back new op lower bound from 7298355278174892032 to 7298355278116020224. Current Snapshot: MvccSnapshot[applied={T|T < 7298355278174892032}]
I20260618 23:23:39.090307 23593 mvcc.cc:205] Tried to move back new op lower bound from 7298355278174892032 to 7298355278116020224. Current Snapshot: MvccSnapshot[applied={T|T < 7298355278174892032}]
I20260618 23:23:39.091732 23103 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:23:39.091835 23103 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:23:39.092782 23103 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 069aa7cd49ae411aa34e84942751b84b: Sending DeleteTablet for 3 replicas of tablet 7320e726f48f4fc09bf2db2e3d7cf928
I20260618 23:23:39.093225 23362 tablet_service.cc:1514] Processing DeleteTablet for tablet 7320e726f48f4fc09bf2db2e3d7cf928 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:23:39 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:47936
I20260618 23:23:39.093299 23228 tablet_service.cc:1514] Processing DeleteTablet for tablet 7320e726f48f4fc09bf2db2e3d7cf928 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:23:39 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:49956
I20260618 23:23:39.093487 23496 tablet_service.cc:1514] Processing DeleteTablet for tablet 7320e726f48f4fc09bf2db2e3d7cf928 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:23:39 UTC) from {username='kudu', principal='kudu/127.3.217.190@KRBTEST.COM'} at 127.0.0.1:40570
I20260618 23:23:39.093689 23602 tablet_replica.cc:330] T 7320e726f48f4fc09bf2db2e3d7cf928 P 4245836c91cf4413a2419b149d792e22: stopping tablet replica
I20260618 23:23:39.093814 23603 tablet_replica.cc:330] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0: stopping tablet replica
I20260618 23:23:39.093824 23602 raft_consensus.cc:2229] T 7320e726f48f4fc09bf2db2e3d7cf928 P 4245836c91cf4413a2419b149d792e22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:23:39.094053 23601 tablet_replica.cc:330] T 7320e726f48f4fc09bf2db2e3d7cf928 P ca0e3d36b9a642998ddf7d000f9685e6: stopping tablet replica
I20260618 23:23:39.094170 23601 raft_consensus.cc:2229] T 7320e726f48f4fc09bf2db2e3d7cf928 P ca0e3d36b9a642998ddf7d000f9685e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:23:39.094218 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 23165
I20260618 23:23:39.094312 23601 raft_consensus.cc:2258] T 7320e726f48f4fc09bf2db2e3d7cf928 P ca0e3d36b9a642998ddf7d000f9685e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:23:39.095523 23601 ts_tablet_manager.cc:1905] T 7320e726f48f4fc09bf2db2e3d7cf928 P ca0e3d36b9a642998ddf7d000f9685e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:23:39.094003 23603 raft_consensus.cc:2229] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0 [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:23:39.097308 23603 raft_consensus.cc:2258] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:23:39.097355 23601 ts_tablet_manager.cc:1918] T 7320e726f48f4fc09bf2db2e3d7cf928 P ca0e3d36b9a642998ddf7d000f9685e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:23:39.097433 23601 log.cc:1196] T 7320e726f48f4fc09bf2db2e3d7cf928 P ca0e3d36b9a642998ddf7d000f9685e6: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/7320e726f48f4fc09bf2db2e3d7cf928
I20260618 23:23:39.097733 23601 ts_tablet_manager.cc:1939] T 7320e726f48f4fc09bf2db2e3d7cf928 P ca0e3d36b9a642998ddf7d000f9685e6: Deleting consensus metadata
I20260618 23:23:39.098093 23603 ts_tablet_manager.cc:1905] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:23:39.098153 23087 catalog_manager.cc:4841] TS ca0e3d36b9a642998ddf7d000f9685e6 (127.3.217.130:46089): tablet 7320e726f48f4fc09bf2db2e3d7cf928 (table test-table [id=f8780d9c92ee45e1bda2113c5bd5f780]) successfully deleted
W20260618 23:23:39.100696 23088 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.217.129:45317 (error 108)
I20260618 23:23:39.100744 23603 ts_tablet_manager.cc:1918] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:23:39.100818 23603 log.cc:1196] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/7320e726f48f4fc09bf2db2e3d7cf928
I20260618 23:23:39.101140 23603 ts_tablet_manager.cc:1939] T 7320e726f48f4fc09bf2db2e3d7cf928 P 92c07022fdba4e57992f3e978e11bea0: Deleting consensus metadata
I20260618 23:23:39.101550 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 23299
I20260618 23:23:39.102521 23088 catalog_manager.cc:4841] TS 92c07022fdba4e57992f3e978e11bea0 (127.3.217.131:46527): tablet 7320e726f48f4fc09bf2db2e3d7cf928 (table test-table [id=f8780d9c92ee45e1bda2113c5bd5f780]) successfully deleted
I20260618 23:23:39.102804 23573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.102026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:45317 (local address 127.0.0.1:49958)
0618 23:23:39.102670 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:39.102773 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.129:45317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":621}
W20260618 23:23:39.102921 23088 catalog_manager.cc:4584] TS 4245836c91cf4413a2419b149d792e22 (127.3.217.129:45317): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7320e726f48f4fc09bf2db2e3d7cf928: Network error: Client connection negotiation failed: client connection to 127.3.217.129:45317: connect: Connection refused (error 111)
I20260618 23:23:39.108716 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 23433
I20260618 23:23:39.113432 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 23071
2026-06-18T23:23:39Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (1951 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-06-18T23:23:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:23:39Z Disabled control of system clock
I20260618 23:23:39.142016 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:33521
--webserver_interface=127.3.217.190
--webserver_port=0
--builtin_ntp_servers=127.3.217.148:42039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:33521
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260618 23:23:39.225208 23608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:39.225423 23608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:39.225445 23608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:39.226926 23608 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:23:39.226974 23608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:39.226987 23608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:39.226999 23608 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:23:39.227047 23608 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:23:39.228535 23608 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:42039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:33521
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:33521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:39.228798 23608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:39.229079 23608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:39.234568 23614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:39.234683 23616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:39.234833 23613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:39.235157 23608 server_base.cc:1034] running on GCE node
I20260618 23:23:39.235460 23608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:39.235764 23608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:39.236963 23608 hybrid_clock.cc:648] HybridClock initialized: now 1781825019236941 us; error 42 us; skew 500 ppm
I20260618 23:23:39.238509 23608 webserver.cc:460] Webserver started at http://127.3.217.190:43843/ using document root <none> and password file <none>
I20260618 23:23:39.238911 23608 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:39.238996 23608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:39.239193 23608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:39.240345 23608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "1e2138dc3b7d4d4bae0dd72de358bde4"
format_stamp: "Formatted at 2026-06-18 23:23:39 on dist-test-slave-r9ct"
server_key: "28a322351f57803d859249d9c52e6a5c"
server_key_iv: "17c028b94cc98420a67ec1832487339f"
server_key_version: "encryptionkey@0"
I20260618 23:23:39.240731 23608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "1e2138dc3b7d4d4bae0dd72de358bde4"
format_stamp: "Formatted at 2026-06-18 23:23:39 on dist-test-slave-r9ct"
server_key: "28a322351f57803d859249d9c52e6a5c"
server_key_iv: "17c028b94cc98420a67ec1832487339f"
server_key_version: "encryptionkey@0"
I20260618 23:23:39.242179 23608 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260618 23:23:39.243080 23622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:39.243290 23608 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:39.243402 23608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "1e2138dc3b7d4d4bae0dd72de358bde4"
format_stamp: "Formatted at 2026-06-18 23:23:39 on dist-test-slave-r9ct"
server_key: "28a322351f57803d859249d9c52e6a5c"
server_key_iv: "17c028b94cc98420a67ec1832487339f"
server_key_version: "encryptionkey@0"
I20260618 23:23:39.243494 23608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:39.253521 23608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:39.253846 23608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:39.254007 23608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:39.259284 23608 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:33521
I20260618 23:23:39.259323 23674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:33521 every 8 connection(s)
I20260618 23:23:39.259668 23608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:23:39.260638 23675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:39.262970 23675 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4: Bootstrap starting.
I20260618 23:23:39.263553 23675 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:39.263851 23675 log.cc:824] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:39.264622 23675 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4: No bootstrap required, opened a new log
I20260618 23:23:39.266305 23675 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e2138dc3b7d4d4bae0dd72de358bde4" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33521 } }
I20260618 23:23:39.266448 23675 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:39.266470 23675 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2138dc3b7d4d4bae0dd72de358bde4, State: Initialized, Role: FOLLOWER
I20260618 23:23:39.266619 23675 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e2138dc3b7d4d4bae0dd72de358bde4" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33521 } }
I20260618 23:23:39.266772 23675 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:23:39.266811 23675 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:23:39.266882 23675 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:39.266873 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 23608
I20260618 23:23:39.266984 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:23:39.267192 3942 external_mini_cluster.cc:1428] Setting key 0289081f357daa17afb863f3ef044076
I20260618 23:23:39.267607 23675 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e2138dc3b7d4d4bae0dd72de358bde4" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33521 } }
I20260618 23:23:39.267733 23675 leader_election.cc:302] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e2138dc3b7d4d4bae0dd72de358bde4; no voters:
I20260618 23:23:39.268024 23675 leader_election.cc:288] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:23:39.268189 23680 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:39.268359 23680 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4 [term 1 LEADER]: Becoming Leader. State: Replica: 1e2138dc3b7d4d4bae0dd72de358bde4, State: Running, Role: LEADER
I20260618 23:23:39.268362 23675 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:23:39.268546 23680 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e2138dc3b7d4d4bae0dd72de358bde4" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33521 } }
I20260618 23:23:39.268939 23682 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e2138dc3b7d4d4bae0dd72de358bde4. Latest consensus state: current_term: 1 leader_uuid: "1e2138dc3b7d4d4bae0dd72de358bde4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e2138dc3b7d4d4bae0dd72de358bde4" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33521 } } }
I20260618 23:23:39.269042 23682 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:39.269028 23681 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e2138dc3b7d4d4bae0dd72de358bde4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e2138dc3b7d4d4bae0dd72de358bde4" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33521 } } }
I20260618 23:23:39.269315 23681 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:39.269496 23688 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:23:39.270032 23688 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:23:39.271742 23688 catalog_manager.cc:1347] Generated new cluster ID: 8fd67869a5f34bd8bd8536ab1728e7de
I20260618 23:23:39.271811 23688 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:23:39.273660 23679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.267753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55488 (local address 127.3.217.190:33521)
0618 23:23:39.268133 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:39.268144 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:39.268186 (+ 42us) server_negotiation.cc:407] Connection header received
0618 23:23:39.268314 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:39.268322 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:39.268408 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:39.268565 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:39.268831 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.270675 (+ 1844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.271738 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.272212 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.272355 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.273032 (+ 677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:39.273035 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:39.273035 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:39.273216 (+ 181us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:39.273247 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:39.273257 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:39.273330 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:39.273414 (+ 84us) server_negotiation.cc:299] Negotiation successful
0618 23:23:39.273492 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":219,"threads_started":1}
I20260618 23:23:39.291982 23688 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:23:39.292788 23688 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:23:39.301391 23688 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4: Generated new TSK 0
I20260618 23:23:39.301600 23688 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:23:39.305774 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.129:0
--local_ip_for_outbound_sockets=127.3.217.129
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:33521
--builtin_ntp_servers=127.3.217.148:42039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260618 23:23:39.394095 23699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:39.394352 23699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:39.394394 23699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:39.395644 23699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:39.395713 23699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:39.395758 23699 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.129
I20260618 23:23:39.397137 23699 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:42039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.217.129
--webserver_port=0
--tserver_master_addrs=127.3.217.190:33521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23699
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.129
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:39.397409 23699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:39.397706 23699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:39.403280 23705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:39.403306 23707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:39.403301 23704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:39.403640 23699 server_base.cc:1034] running on GCE node
I20260618 23:23:39.403887 23699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:39.404157 23699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:39.405349 23699 hybrid_clock.cc:648] HybridClock initialized: now 1781825019405332 us; error 31 us; skew 500 ppm
I20260618 23:23:39.406641 23699 webserver.cc:460] Webserver started at http://127.3.217.129:33407/ using document root <none> and password file <none>
I20260618 23:23:39.406934 23699 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:39.406989 23699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:39.407080 23699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:39.408070 23699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-0/data/instance:
uuid: "0fa0b4dc9ed54a3a95d211e5900e52a1"
format_stamp: "Formatted at 2026-06-18 23:23:39 on dist-test-slave-r9ct"
server_key: "7f8718dbf380f891300062bf7d6accb7"
server_key_iv: "2f910b5ee82a6b671dc0e1a28611ad0c"
server_key_version: "encryptionkey@0"
I20260618 23:23:39.408370 23699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance:
uuid: "0fa0b4dc9ed54a3a95d211e5900e52a1"
format_stamp: "Formatted at 2026-06-18 23:23:39 on dist-test-slave-r9ct"
server_key: "7f8718dbf380f891300062bf7d6accb7"
server_key_iv: "2f910b5ee82a6b671dc0e1a28611ad0c"
server_key_version: "encryptionkey@0"
I20260618 23:23:39.409629 23699 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:23:39.410660 23713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:39.410923 23699 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:39.411008 23699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-0/wal
uuid: "0fa0b4dc9ed54a3a95d211e5900e52a1"
format_stamp: "Formatted at 2026-06-18 23:23:39 on dist-test-slave-r9ct"
server_key: "7f8718dbf380f891300062bf7d6accb7"
server_key_iv: "2f910b5ee82a6b671dc0e1a28611ad0c"
server_key_version: "encryptionkey@0"
I20260618 23:23:39.411059 23699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:39.436180 23699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:39.436506 23699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:39.436614 23699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:39.436810 23699 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:23:39.437181 23699 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:23:39.437235 23699 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:39.437295 23699 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:23:39.437325 23699 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:39.443522 23699 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.129:46005
I20260618 23:23:39.443714 23826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.129:46005 every 8 connection(s)
I20260618 23:23:39.443930 23699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-0/data/info.pb
I20260618 23:23:39.450062 23679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.444661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.129:58287 (local address 127.3.217.190:33521)
0618 23:23:39.444835 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:39.444838 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:39.445153 (+ 315us) server_negotiation.cc:407] Connection header received
0618 23:23:39.445810 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:39.445810 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:39.445828 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:39.445888 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:39.446886 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.447430 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.448422 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.448626 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.448706 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.449691 (+ 985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:39.449692 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:39.449692 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:39.449697 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:39.449713 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:39.449718 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:39.449783 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:39.449863 (+ 80us) server_negotiation.cc:299] Negotiation successful
0618 23:23:39.449900 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260618 23:23:39.450429 23829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.444634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33521 (local address 127.3.217.129:58287)
0618 23:23:39.444950 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:39.445017 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:39.445695 (+ 678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:39.445965 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:39.445970 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:39.445981 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:23:39.446781 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.446788 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.447525 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.447526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.448322 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.448324 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.448719 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.448720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.448866 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.449533 (+ 667us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:23:39.449533 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:23:39.449565 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:23:39.449590 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:23:39.449783 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:23:39.449789 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:23:39.449793 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:23:39.449864 (+ 71us) client_negotiation.cc:240] Negotiation successful
0618 23:23:39.449977 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":115,"threads_started":1}
I20260618 23:23:39.451064 23827 heartbeater.cc:347] Connected to a master server at 127.3.217.190:33521
I20260618 23:23:39.451160 23827 heartbeater.cc:464] Registering TS with master...
I20260618 23:23:39.451269 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 23699
I20260618 23:23:39.451390 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-0/wal/instance
I20260618 23:23:39.451442 23827 heartbeater.cc:511] Master 127.3.217.190:33521 requested a full tablet report, sending...
I20260618 23:23:39.451627 3942 external_mini_cluster.cc:1428] Setting key 55ad32f1d9aad2bb1a2a48955740e69d
I20260618 23:23:39.452030 23639 ts_manager.cc:194] Registered new tserver with Master: 0fa0b4dc9ed54a3a95d211e5900e52a1 (127.3.217.129:46005)
I20260618 23:23:39.452890 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.130:0
--local_ip_for_outbound_sockets=127.3.217.130
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:33521
--builtin_ntp_servers=127.3.217.148:42039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260618 23:23:39.452890 23639 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.217.129:58287
W20260618 23:23:39.534806 23830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:39.535027 23830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:39.535059 23830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:39.536149 23830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:39.536216 23830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:39.536259 23830 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.130
I20260618 23:23:39.537554 23830 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:42039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.217.130
--webserver_port=0
--tserver_master_addrs=127.3.217.190:33521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.130
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:39.537817 23830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:39.538102 23830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:39.543066 23838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:39.543066 23836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:39.543109 23835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:39.543524 23830 server_base.cc:1034] running on GCE node
I20260618 23:23:39.543716 23830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:39.543958 23830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:39.545135 23830 hybrid_clock.cc:648] HybridClock initialized: now 1781825019545121 us; error 28 us; skew 500 ppm
I20260618 23:23:39.546516 23830 webserver.cc:460] Webserver started at http://127.3.217.130:44857/ using document root <none> and password file <none>
I20260618 23:23:39.546867 23830 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:39.546931 23830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:39.547062 23830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:39.548123 23830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-1/data/instance:
uuid: "f406ecf0066b49a1a8f908730f2c900c"
format_stamp: "Formatted at 2026-06-18 23:23:39 on dist-test-slave-r9ct"
server_key: "9270f0e54dabf676e7411ad238e9ef85"
server_key_iv: "fc9fa2d7f183c70a4c63a978a2628e21"
server_key_version: "encryptionkey@0"
I20260618 23:23:39.548466 23830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance:
uuid: "f406ecf0066b49a1a8f908730f2c900c"
format_stamp: "Formatted at 2026-06-18 23:23:39 on dist-test-slave-r9ct"
server_key: "9270f0e54dabf676e7411ad238e9ef85"
server_key_iv: "fc9fa2d7f183c70a4c63a978a2628e21"
server_key_version: "encryptionkey@0"
I20260618 23:23:39.549942 23830 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260618 23:23:39.550923 23844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:39.551101 23830 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:23:39.551247 23830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-1/wal
uuid: "f406ecf0066b49a1a8f908730f2c900c"
format_stamp: "Formatted at 2026-06-18 23:23:39 on dist-test-slave-r9ct"
server_key: "9270f0e54dabf676e7411ad238e9ef85"
server_key_iv: "fc9fa2d7f183c70a4c63a978a2628e21"
server_key_version: "encryptionkey@0"
I20260618 23:23:39.551339 23830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:39.582142 23830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:39.582495 23830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:39.582648 23830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:39.582917 23830 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:23:39.583385 23830 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:23:39.583457 23830 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:39.583503 23830 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:23:39.583551 23830 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:39.590312 23830 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.130:46761
I20260618 23:23:39.590441 23957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.130:46761 every 8 connection(s)
I20260618 23:23:39.590759 23830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-1/data/info.pb
I20260618 23:23:39.596738 23679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.591616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:53687 (local address 127.3.217.190:33521)
0618 23:23:39.591678 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:39.591680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:39.591913 (+ 233us) server_negotiation.cc:407] Connection header received
0618 23:23:39.592483 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:39.592484 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:39.592496 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:39.592553 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:39.593234 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.593749 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.594748 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.594961 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.595183 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.596440 (+ 1257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:39.596442 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:39.596442 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:39.596448 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:39.596467 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:39.596472 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:39.596522 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:39.596620 (+ 98us) server_negotiation.cc:299] Negotiation successful
0618 23:23:39.596651 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260618 23:23:39.596968 23960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.591587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33521 (local address 127.3.217.130:53687)
0618 23:23:39.591796 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:39.591828 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:39.592370 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:39.592616 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:39.592620 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:39.592629 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:23:39.593122 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.593125 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.593851 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.593852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.594629 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.594631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.595223 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.595225 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.595427 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.596275 (+ 848us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:23:39.596276 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:23:39.596308 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:23:39.596334 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:23:39.596523 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:23:39.596527 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:23:39.596530 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:23:39.596609 (+ 79us) client_negotiation.cc:240] Negotiation successful
0618 23:23:39.596717 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":90,"threads_started":1}
I20260618 23:23:39.597514 23958 heartbeater.cc:347] Connected to a master server at 127.3.217.190:33521
I20260618 23:23:39.597592 23958 heartbeater.cc:464] Registering TS with master...
I20260618 23:23:39.597806 23958 heartbeater.cc:511] Master 127.3.217.190:33521 requested a full tablet report, sending...
I20260618 23:23:39.598142 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 23830
I20260618 23:23:39.598290 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-1/wal/instance
I20260618 23:23:39.598333 23639 ts_manager.cc:194] Registered new tserver with Master: f406ecf0066b49a1a8f908730f2c900c (127.3.217.130:46761)
I20260618 23:23:39.598589 3942 external_mini_cluster.cc:1428] Setting key b85adacf6781dc5ccd6b30f812c3c5af
I20260618 23:23:39.598752 23639 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.217.130:53687
I20260618 23:23:39.599577 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.217.131:0
--local_ip_for_outbound_sockets=127.3.217.131
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:33521
--builtin_ntp_servers=127.3.217.148:42039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260618 23:23:39.683820 23961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:39.684137 23961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:39.684190 23961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:39.685429 23961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:39.685479 23961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:39.685511 23961 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.217.131
I20260618 23:23:39.687196 23961 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:42039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.217.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.217.131
--webserver_port=0
--tserver_master_addrs=127.3.217.190:33521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23961
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.217.131
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:39.687419 23961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:39.687676 23961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:39.692826 23967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:39.692819 23969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:39.692836 23961 server_base.cc:1034] running on GCE node
W20260618 23:23:39.692819 23966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:39.693305 23961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:39.693521 23961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:39.694664 23961 hybrid_clock.cc:648] HybridClock initialized: now 1781825019694653 us; error 29 us; skew 500 ppm
I20260618 23:23:39.696071 23961 webserver.cc:460] Webserver started at http://127.3.217.131:40371/ using document root <none> and password file <none>
I20260618 23:23:39.696570 23961 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:39.696753 23961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:39.696957 23961 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:39.698406 23961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-2/data/instance:
uuid: "71350801cbc6438e98ddcdc7de6e4811"
format_stamp: "Formatted at 2026-06-18 23:23:39 on dist-test-slave-r9ct"
server_key: "3286749a5a0dbe78194edd13421e46ef"
server_key_iv: "dddf063116006552b590e3c368694004"
server_key_version: "encryptionkey@0"
I20260618 23:23:39.698886 23961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance:
uuid: "71350801cbc6438e98ddcdc7de6e4811"
format_stamp: "Formatted at 2026-06-18 23:23:39 on dist-test-slave-r9ct"
server_key: "3286749a5a0dbe78194edd13421e46ef"
server_key_iv: "dddf063116006552b590e3c368694004"
server_key_version: "encryptionkey@0"
I20260618 23:23:39.700412 23961 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:23:39.701411 23975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:39.701622 23961 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:23:39.701725 23961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-2/wal
uuid: "71350801cbc6438e98ddcdc7de6e4811"
format_stamp: "Formatted at 2026-06-18 23:23:39 on dist-test-slave-r9ct"
server_key: "3286749a5a0dbe78194edd13421e46ef"
server_key_iv: "dddf063116006552b590e3c368694004"
server_key_version: "encryptionkey@0"
I20260618 23:23:39.701829 23961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:39.718524 23961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:39.718894 23961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:39.719048 23961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:39.719285 23961 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260618 23:23:39.719614 23961 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 23:23:39.719686 23961 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:39.719729 23961 ts_tablet_manager.cc:610] Registered 0 tablets
I20260618 23:23:39.719756 23961 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:39.725884 23961 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.131:36963
I20260618 23:23:39.725932 24088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.131:36963 every 8 connection(s)
I20260618 23:23:39.726432 23961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-2/data/info.pb
I20260618 23:23:39.732174 23679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.727249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.131:51809 (local address 127.3.217.190:33521)
0618 23:23:39.727322 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:39.727324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:39.727511 (+ 187us) server_negotiation.cc:407] Connection header received
0618 23:23:39.728066 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:39.728068 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:39.728085 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:39.728189 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:39.728945 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.729501 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.730487 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.730685 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.730769 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.731733 (+ 964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:39.731735 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:39.731736 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:39.731742 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:39.731766 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:39.731772 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:39.731850 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:39.732036 (+ 186us) server_negotiation.cc:299] Negotiation successful
0618 23:23:39.732086 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260618 23:23:39.732224 24091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.727192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:33521 (local address 127.3.217.131:51809)
0618 23:23:39.727376 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:39.727417 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:39.727885 (+ 468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:39.728258 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:39.728261 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:39.728270 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:23:39.728797 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.728801 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.729604 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.729604 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.730383 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.730385 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.730853 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.730854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.730966 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.731508 (+ 542us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0618 23:23:39.731509 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:23:39.731537 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0618 23:23:39.731565 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:23:39.731905 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:23:39.731910 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:23:39.731912 (+ 2us) client_negotiation.cc:769] Sending connection context
0618 23:23:39.731988 (+ 76us) client_negotiation.cc:240] Negotiation successful
0618 23:23:39.732068 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":93,"threads_started":1}
I20260618 23:23:39.733125 24089 heartbeater.cc:347] Connected to a master server at 127.3.217.190:33521
I20260618 23:23:39.733250 24089 heartbeater.cc:464] Registering TS with master...
I20260618 23:23:39.733397 24089 heartbeater.cc:511] Master 127.3.217.190:33521 requested a full tablet report, sending...
I20260618 23:23:39.733853 23639 ts_manager.cc:194] Registered new tserver with Master: 71350801cbc6438e98ddcdc7de6e4811 (127.3.217.131:36963)
I20260618 23:23:39.734194 23639 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.217.131:51809
I20260618 23:23:39.735637 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 23961
I20260618 23:23:39.735787 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-2/wal/instance
I20260618 23:23:39.736019 3942 external_mini_cluster.cc:1428] Setting key 18ac5eb0702794523364f73968346cc5
I20260618 23:23:39.737306 3942 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260618 23:23:39.742118 23679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.738858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55494 (local address 127.3.217.190:33521)
0618 23:23:39.738941 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:39.738943 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:39.738996 (+ 53us) server_negotiation.cc:407] Connection header received
0618 23:23:39.739131 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:39.739133 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:39.739154 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:39.739260 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:39.739623 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.740106 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.740870 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.741092 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.741168 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.741855 (+ 687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:39.741856 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:39.741856 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:39.741861 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:39.741876 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:39.741880 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:39.741947 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:39.742008 (+ 61us) server_negotiation.cc:299] Negotiation successful
0618 23:23:39.742030 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260618 23:23:39.744161 23639 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55494:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 23:23:39.745589 23639 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 23:23:39.751863 24099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.747917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42974 (local address 127.3.217.131:36963)
0618 23:23:39.748196 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:39.748200 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:39.748209 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:23:39.748250 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:39.748252 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:39.748270 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:39.748343 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:39.748568 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.749735 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.750939 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.751461 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.751557 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.751641 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:39.751735 (+ 94us) server_negotiation.cc:299] Negotiation successful
0618 23:23:39.751779 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":86,"threads_started":1}
I20260618 23:23:39.751878 24098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.747830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:36963 (local address 127.0.0.1:42974)
0618 23:23:39.748001 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:39.748038 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:39.748102 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:39.748417 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:39.748420 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:39.748421 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:39.748484 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.748486 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.749832 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.749833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.750855 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.750858 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.751561 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.751562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.751636 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.751649 (+ 13us) client_negotiation.cc:769] Sending connection context
0618 23:23:39.751721 (+ 72us) client_negotiation.cc:240] Negotiation successful
0618 23:23:39.751773 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"mutex_wait_us":33,"thread_start_us":74,"threads_started":1}
I20260618 23:23:39.752002 24097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.748042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:46005 (local address 127.0.0.1:48338)
0618 23:23:39.748234 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:39.748245 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:39.748286 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:39.748591 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:39.748592 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:39.748593 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:39.748627 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.748628 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.749901 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.749902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.750960 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.750962 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.751824 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.751825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.751878 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.751882 (+ 4us) client_negotiation.cc:769] Sending connection context
0618 23:23:39.751912 (+ 30us) client_negotiation.cc:240] Negotiation successful
0618 23:23:39.751945 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":67,"threads_started":1}
I20260618 23:23:39.752040 24100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.747936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55998 (local address 127.3.217.130:46761)
0618 23:23:39.748115 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:39.748120 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:39.748293 (+ 173us) server_negotiation.cc:407] Connection header received
0618 23:23:39.748345 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:39.748348 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:39.748364 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:39.748440 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:39.748665 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.749369 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.750733 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.751462 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.751532 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.751620 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:39.751921 (+ 301us) server_negotiation.cc:299] Negotiation successful
0618 23:23:39.751958 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":83,"threads_started":1}
I20260618 23:23:39.752417 24102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.748248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48338 (local address 127.3.217.129:46005)
0618 23:23:39.748433 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:39.748437 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:39.748446 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:23:39.748482 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:39.748483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:39.748498 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:39.748692 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:39.748743 (+ 51us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.749821 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.751043 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.751738 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.752078 (+ 340us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.752223 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:39.752244 (+ 21us) server_negotiation.cc:299] Negotiation successful
0618 23:23:39.752275 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":107,"threads_started":1}
I20260618 23:23:39.752426 24101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.747848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.130:46761 (local address 127.0.0.1:55998)
0618 23:23:39.748164 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:39.748175 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:39.748231 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:39.748529 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:39.748530 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:39.748532 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:39.748588 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.748590 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.749457 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.749458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.750629 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.750632 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.751656 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.751657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.751718 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.751724 (+ 6us) client_negotiation.cc:769] Sending connection context
0618 23:23:39.751778 (+ 54us) client_negotiation.cc:240] Negotiation successful
0618 23:23:39.751826 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":50,"threads_started":1}
I20260618 23:23:39.753052 24023 tablet_service.cc:1467] Processing CreateTablet for tablet d826894952d94063b088a6012a5b9324 (DEFAULT_TABLE table=test-table [id=b6123ffff96443199fd6c9ed8b928973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:23:39.753086 23761 tablet_service.cc:1467] Processing CreateTablet for tablet d826894952d94063b088a6012a5b9324 (DEFAULT_TABLE table=test-table [id=b6123ffff96443199fd6c9ed8b928973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:23:39.753262 23892 tablet_service.cc:1467] Processing CreateTablet for tablet d826894952d94063b088a6012a5b9324 (DEFAULT_TABLE table=test-table [id=b6123ffff96443199fd6c9ed8b928973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 23:23:39.753422 24023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d826894952d94063b088a6012a5b9324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:39.753422 23761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d826894952d94063b088a6012a5b9324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:39.753557 23892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d826894952d94063b088a6012a5b9324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:39.756388 24103 tablet_bootstrap.cc:492] T d826894952d94063b088a6012a5b9324 P 0fa0b4dc9ed54a3a95d211e5900e52a1: Bootstrap starting.
I20260618 23:23:39.756968 24105 tablet_bootstrap.cc:492] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c: Bootstrap starting.
I20260618 23:23:39.757042 24104 tablet_bootstrap.cc:492] T d826894952d94063b088a6012a5b9324 P 71350801cbc6438e98ddcdc7de6e4811: Bootstrap starting.
I20260618 23:23:39.757031 24103 tablet_bootstrap.cc:654] T d826894952d94063b088a6012a5b9324 P 0fa0b4dc9ed54a3a95d211e5900e52a1: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:39.757332 24103 log.cc:824] T d826894952d94063b088a6012a5b9324 P 0fa0b4dc9ed54a3a95d211e5900e52a1: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:39.757620 24104 tablet_bootstrap.cc:654] T d826894952d94063b088a6012a5b9324 P 71350801cbc6438e98ddcdc7de6e4811: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:39.757620 24105 tablet_bootstrap.cc:654] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:39.757946 24105 log.cc:824] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:39.757941 24104 log.cc:824] T d826894952d94063b088a6012a5b9324 P 71350801cbc6438e98ddcdc7de6e4811: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:39.758024 24103 tablet_bootstrap.cc:492] T d826894952d94063b088a6012a5b9324 P 0fa0b4dc9ed54a3a95d211e5900e52a1: No bootstrap required, opened a new log
I20260618 23:23:39.758091 24103 ts_tablet_manager.cc:1397] T d826894952d94063b088a6012a5b9324 P 0fa0b4dc9ed54a3a95d211e5900e52a1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:23:39.758838 24105 tablet_bootstrap.cc:492] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c: No bootstrap required, opened a new log
I20260618 23:23:39.758905 24105 ts_tablet_manager.cc:1397] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260618 23:23:39.759097 24104 tablet_bootstrap.cc:492] T d826894952d94063b088a6012a5b9324 P 71350801cbc6438e98ddcdc7de6e4811: No bootstrap required, opened a new log
I20260618 23:23:39.759259 24104 ts_tablet_manager.cc:1397] T d826894952d94063b088a6012a5b9324 P 71350801cbc6438e98ddcdc7de6e4811: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 23:23:39.760389 24103 raft_consensus.cc:348] T d826894952d94063b088a6012a5b9324 P 0fa0b4dc9ed54a3a95d211e5900e52a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71350801cbc6438e98ddcdc7de6e4811" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36963 } } peers { permanent_uuid: "f406ecf0066b49a1a8f908730f2c900c" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 46761 } } peers { permanent_uuid: "0fa0b4dc9ed54a3a95d211e5900e52a1" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 46005 } }
I20260618 23:23:39.760571 24103 raft_consensus.cc:374] T d826894952d94063b088a6012a5b9324 P 0fa0b4dc9ed54a3a95d211e5900e52a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:39.760615 24103 raft_consensus.cc:729] T d826894952d94063b088a6012a5b9324 P 0fa0b4dc9ed54a3a95d211e5900e52a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa0b4dc9ed54a3a95d211e5900e52a1, State: Initialized, Role: FOLLOWER
I20260618 23:23:39.760744 24103 consensus_queue.cc:260] T d826894952d94063b088a6012a5b9324 P 0fa0b4dc9ed54a3a95d211e5900e52a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71350801cbc6438e98ddcdc7de6e4811" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36963 } } peers { permanent_uuid: "f406ecf0066b49a1a8f908730f2c900c" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 46761 } } peers { permanent_uuid: "0fa0b4dc9ed54a3a95d211e5900e52a1" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 46005 } }
I20260618 23:23:39.761014 24103 ts_tablet_manager.cc:1428] T d826894952d94063b088a6012a5b9324 P 0fa0b4dc9ed54a3a95d211e5900e52a1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260618 23:23:39.761144 23827 heartbeater.cc:503] Master 127.3.217.190:33521 was elected leader, sending a full tablet report...
I20260618 23:23:39.761443 24105 raft_consensus.cc:348] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71350801cbc6438e98ddcdc7de6e4811" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36963 } } peers { permanent_uuid: "f406ecf0066b49a1a8f908730f2c900c" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 46761 } } peers { permanent_uuid: "0fa0b4dc9ed54a3a95d211e5900e52a1" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 46005 } }
I20260618 23:23:39.761603 24105 raft_consensus.cc:374] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:39.761636 24105 raft_consensus.cc:729] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f406ecf0066b49a1a8f908730f2c900c, State: Initialized, Role: FOLLOWER
I20260618 23:23:39.761759 24105 consensus_queue.cc:260] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71350801cbc6438e98ddcdc7de6e4811" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36963 } } peers { permanent_uuid: "f406ecf0066b49a1a8f908730f2c900c" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 46761 } } peers { permanent_uuid: "0fa0b4dc9ed54a3a95d211e5900e52a1" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 46005 } }
I20260618 23:23:39.761775 24104 raft_consensus.cc:348] T d826894952d94063b088a6012a5b9324 P 71350801cbc6438e98ddcdc7de6e4811 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71350801cbc6438e98ddcdc7de6e4811" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36963 } } peers { permanent_uuid: "f406ecf0066b49a1a8f908730f2c900c" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 46761 } } peers { permanent_uuid: "0fa0b4dc9ed54a3a95d211e5900e52a1" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 46005 } }
I20260618 23:23:39.761915 24104 raft_consensus.cc:374] T d826894952d94063b088a6012a5b9324 P 71350801cbc6438e98ddcdc7de6e4811 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:39.761958 24104 raft_consensus.cc:729] T d826894952d94063b088a6012a5b9324 P 71350801cbc6438e98ddcdc7de6e4811 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71350801cbc6438e98ddcdc7de6e4811, State: Initialized, Role: FOLLOWER
I20260618 23:23:39.762001 24105 ts_tablet_manager.cc:1428] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260618 23:23:39.762076 24104 consensus_queue.cc:260] T d826894952d94063b088a6012a5b9324 P 71350801cbc6438e98ddcdc7de6e4811 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71350801cbc6438e98ddcdc7de6e4811" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36963 } } peers { permanent_uuid: "f406ecf0066b49a1a8f908730f2c900c" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 46761 } } peers { permanent_uuid: "0fa0b4dc9ed54a3a95d211e5900e52a1" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 46005 } }
I20260618 23:23:39.762106 23958 heartbeater.cc:503] Master 127.3.217.190:33521 was elected leader, sending a full tablet report...
I20260618 23:23:39.762372 24104 ts_tablet_manager.cc:1428] T d826894952d94063b088a6012a5b9324 P 71350801cbc6438e98ddcdc7de6e4811: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260618 23:23:39.762398 24089 heartbeater.cc:503] Master 127.3.217.190:33521 was elected leader, sending a full tablet report...
W20260618 23:23:39.841349 23959 tablet.cc:2369] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 23:23:39.904551 24110 raft_consensus.cc:482] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 23:23:39.905004 24110 raft_consensus.cc:504] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71350801cbc6438e98ddcdc7de6e4811" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36963 } } peers { permanent_uuid: "f406ecf0066b49a1a8f908730f2c900c" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 46761 } } peers { permanent_uuid: "0fa0b4dc9ed54a3a95d211e5900e52a1" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 46005 } }
I20260618 23:23:39.905417 24110 leader_election.cc:288] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71350801cbc6438e98ddcdc7de6e4811 (127.3.217.131:36963), 0fa0b4dc9ed54a3a95d211e5900e52a1 (127.3.217.129:46005)
I20260618 23:23:39.909350 24099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.905679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:58507 (local address 127.3.217.131:36963)
0618 23:23:39.905729 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:39.905731 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:39.905742 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:23:39.905867 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:39.905869 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:39.905879 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:39.905941 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:39.906124 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.906909 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.908435 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.908978 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.909054 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.909062 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:39.909242 (+ 180us) server_negotiation.cc:299] Negotiation successful
0618 23:23:39.909279 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260618 23:23:39.909368 24102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.905848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.217.130:60579 (local address 127.3.217.129:46005)
0618 23:23:39.905905 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:39.905907 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:39.905934 (+ 27us) server_negotiation.cc:407] Connection header received
0618 23:23:39.906014 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:39.906015 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:39.906029 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:39.906069 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0618 23:23:39.906289 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.906979 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.908435 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.908978 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.909054 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.909062 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:39.909236 (+ 174us) server_negotiation.cc:299] Negotiation successful
0618 23:23:39.909309 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260618 23:23:39.909363 23960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.905596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.131:36963 (local address 127.3.217.130:58507)
0618 23:23:39.905661 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:39.905675 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:39.905742 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:39.905948 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:39.905949 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:39.905951 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:39.906029 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.906030 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.906991 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.906992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.908324 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.908327 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.909064 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.909065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.909171 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.909174 (+ 3us) client_negotiation.cc:769] Sending connection context
0618 23:23:39.909224 (+ 50us) client_negotiation.cc:240] Negotiation successful
0618 23:23:39.909252 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":39}
I20260618 23:23:39.909368 24112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.905733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:46005 (local address 127.3.217.130:60579)
0618 23:23:39.905880 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:39.905890 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:23:39.905943 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:23:39.906091 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:23:39.906092 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:23:39.906103 (+ 11us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0618 23:23:39.906169 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.906170 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.907053 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.907054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.908329 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:23:39.908331 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.909064 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.909065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:23:39.909138 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.909143 (+ 5us) client_negotiation.cc:769] Sending connection context
0618 23:23:39.909204 (+ 61us) client_negotiation.cc:240] Negotiation successful
0618 23:23:39.909247 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":67,"thread_start_us":88,"threads_started":1}
I20260618 23:23:39.909761 23781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d826894952d94063b088a6012a5b9324" candidate_uuid: "f406ecf0066b49a1a8f908730f2c900c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa0b4dc9ed54a3a95d211e5900e52a1" is_pre_election: true
I20260618 23:23:39.909761 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d826894952d94063b088a6012a5b9324" candidate_uuid: "f406ecf0066b49a1a8f908730f2c900c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71350801cbc6438e98ddcdc7de6e4811" is_pre_election: true
I20260618 23:23:39.909905 23781 raft_consensus.cc:2454] T d826894952d94063b088a6012a5b9324 P 0fa0b4dc9ed54a3a95d211e5900e52a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f406ecf0066b49a1a8f908730f2c900c in term 0.
I20260618 23:23:39.909905 24043 raft_consensus.cc:2454] T d826894952d94063b088a6012a5b9324 P 71350801cbc6438e98ddcdc7de6e4811 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f406ecf0066b49a1a8f908730f2c900c in term 0.
I20260618 23:23:39.910168 23845 leader_election.cc:302] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71350801cbc6438e98ddcdc7de6e4811, f406ecf0066b49a1a8f908730f2c900c; no voters:
I20260618 23:23:39.910329 24110 raft_consensus.cc:2781] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 23:23:39.910410 24110 raft_consensus.cc:482] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 23:23:39.910445 24110 raft_consensus.cc:3037] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:39.911154 24110 raft_consensus.cc:504] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71350801cbc6438e98ddcdc7de6e4811" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36963 } } peers { permanent_uuid: "f406ecf0066b49a1a8f908730f2c900c" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 46761 } } peers { permanent_uuid: "0fa0b4dc9ed54a3a95d211e5900e52a1" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 46005 } }
I20260618 23:23:39.911294 24110 leader_election.cc:288] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c [CANDIDATE]: Term 1 election: Requested vote from peers 71350801cbc6438e98ddcdc7de6e4811 (127.3.217.131:36963), 0fa0b4dc9ed54a3a95d211e5900e52a1 (127.3.217.129:46005)
I20260618 23:23:39.911464 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d826894952d94063b088a6012a5b9324" candidate_uuid: "f406ecf0066b49a1a8f908730f2c900c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71350801cbc6438e98ddcdc7de6e4811"
I20260618 23:23:39.911471 23781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d826894952d94063b088a6012a5b9324" candidate_uuid: "f406ecf0066b49a1a8f908730f2c900c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fa0b4dc9ed54a3a95d211e5900e52a1"
I20260618 23:23:39.911556 24043 raft_consensus.cc:3037] T d826894952d94063b088a6012a5b9324 P 71350801cbc6438e98ddcdc7de6e4811 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:39.911552 23781 raft_consensus.cc:3037] T d826894952d94063b088a6012a5b9324 P 0fa0b4dc9ed54a3a95d211e5900e52a1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:39.912227 23781 raft_consensus.cc:2454] T d826894952d94063b088a6012a5b9324 P 0fa0b4dc9ed54a3a95d211e5900e52a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f406ecf0066b49a1a8f908730f2c900c in term 1.
I20260618 23:23:39.912232 24043 raft_consensus.cc:2454] T d826894952d94063b088a6012a5b9324 P 71350801cbc6438e98ddcdc7de6e4811 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f406ecf0066b49a1a8f908730f2c900c in term 1.
I20260618 23:23:39.912385 23845 leader_election.cc:302] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71350801cbc6438e98ddcdc7de6e4811, f406ecf0066b49a1a8f908730f2c900c; no voters:
I20260618 23:23:39.912509 24110 raft_consensus.cc:2781] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:39.912659 24110 raft_consensus.cc:686] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c [term 1 LEADER]: Becoming Leader. State: Replica: f406ecf0066b49a1a8f908730f2c900c, State: Running, Role: LEADER
I20260618 23:23:39.912761 24110 consensus_queue.cc:237] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71350801cbc6438e98ddcdc7de6e4811" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36963 } } peers { permanent_uuid: "f406ecf0066b49a1a8f908730f2c900c" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 46761 } } peers { permanent_uuid: "0fa0b4dc9ed54a3a95d211e5900e52a1" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 46005 } }
I20260618 23:23:39.913559 23638 catalog_manager.cc:5495] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c reported cstate change: term changed from 0 to 1, leader changed from <none> to f406ecf0066b49a1a8f908730f2c900c (127.3.217.130). New cstate: current_term: 1 leader_uuid: "f406ecf0066b49a1a8f908730f2c900c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71350801cbc6438e98ddcdc7de6e4811" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f406ecf0066b49a1a8f908730f2c900c" member_type: VOTER last_known_addr { host: "127.3.217.130" port: 46761 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fa0b4dc9ed54a3a95d211e5900e52a1" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 46005 } health_report { overall_health: UNKNOWN } } }
I20260618 23:23:39.933662 24100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.931260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56004 (local address 127.3.217.130:46761)
0618 23:23:39.931330 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:39.931332 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:39.931344 (+ 12us) server_negotiation.cc:407] Connection header received
0618 23:23:39.931442 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:39.931443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:39.931470 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:39.931540 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:23:39.931682 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.932143 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.932894 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:39.933083 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:39.933155 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:39.933335 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:23:39.933422 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:23:39.933517 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:39.933536 (+ 19us) server_negotiation.cc:299] Negotiation successful
0618 23:23:39.933555 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260618 23:23:39.935379 24043 raft_consensus.cc:1261] T d826894952d94063b088a6012a5b9324 P 71350801cbc6438e98ddcdc7de6e4811 [term 1 FOLLOWER]: Refusing update from remote peer f406ecf0066b49a1a8f908730f2c900c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:23:39.935388 23781 raft_consensus.cc:1261] T d826894952d94063b088a6012a5b9324 P 0fa0b4dc9ed54a3a95d211e5900e52a1 [term 1 FOLLOWER]: Refusing update from remote peer f406ecf0066b49a1a8f908730f2c900c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:23:39.935734 24113 consensus_queue.cc:1035] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c [LEADER]: Connected to new peer: Peer: permanent_uuid: "71350801cbc6438e98ddcdc7de6e4811" member_type: VOTER last_known_addr { host: "127.3.217.131" port: 36963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:23:39.935883 24110 consensus_queue.cc:1035] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fa0b4dc9ed54a3a95d211e5900e52a1" member_type: VOTER last_known_addr { host: "127.3.217.129" port: 46005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:23:39.938298 24117 mvcc.cc:205] Tried to move back new op lower bound from 7298355281652842496 to 7298355281563258880. Current Snapshot: MvccSnapshot[applied={T|T < 7298355281652842496}]
I20260618 23:23:39.940249 23637 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55494:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:23:39.940359 23637 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55494:
table { table_name: "test-table" } modify_external_catalogs: true
I20260618 23:23:39.941039 23637 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1e2138dc3b7d4d4bae0dd72de358bde4: Sending DeleteTablet for 3 replicas of tablet d826894952d94063b088a6012a5b9324
I20260618 23:23:39.941327 23892 tablet_service.cc:1514] Processing DeleteTablet for tablet d826894952d94063b088a6012a5b9324 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:23:39 UTC) from {username='slave'} at 127.0.0.1:55998
I20260618 23:23:39.941382 23761 tablet_service.cc:1514] Processing DeleteTablet for tablet d826894952d94063b088a6012a5b9324 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:23:39 UTC) from {username='slave'} at 127.0.0.1:48338
I20260618 23:23:39.941397 24023 tablet_service.cc:1514] Processing DeleteTablet for tablet d826894952d94063b088a6012a5b9324 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-18 23:23:39 UTC) from {username='slave'} at 127.0.0.1:42974
I20260618 23:23:39.941538 24125 tablet_replica.cc:330] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c: stopping tablet replica
I20260618 23:23:39.941632 24125 raft_consensus.cc:2229] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c [term 1 LEADER]: Raft consensus shutting down.
I20260618 23:23:39.941720 24125 raft_consensus.cc:2258] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:23:39.941828 24127 tablet_replica.cc:330] T d826894952d94063b088a6012a5b9324 P 71350801cbc6438e98ddcdc7de6e4811: stopping tablet replica
I20260618 23:23:39.941936 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 23699
I20260618 23:23:39.942116 24125 ts_tablet_manager.cc:1905] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:23:39.943811 24125 ts_tablet_manager.cc:1918] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:23:39.943892 24125 log.cc:1196] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-1/wal/wals/d826894952d94063b088a6012a5b9324
I20260618 23:23:39.944130 24125 ts_tablet_manager.cc:1939] T d826894952d94063b088a6012a5b9324 P f406ecf0066b49a1a8f908730f2c900c: Deleting consensus metadata
I20260618 23:23:39.944486 23625 catalog_manager.cc:4841] TS f406ecf0066b49a1a8f908730f2c900c (127.3.217.130:46761): tablet d826894952d94063b088a6012a5b9324 (table test-table [id=b6123ffff96443199fd6c9ed8b928973]) successfully deleted
I20260618 23:23:39.945855 24127 raft_consensus.cc:2229] T d826894952d94063b088a6012a5b9324 P 71350801cbc6438e98ddcdc7de6e4811 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 23:23:39.945971 24127 raft_consensus.cc:2258] T d826894952d94063b088a6012a5b9324 P 71350801cbc6438e98ddcdc7de6e4811 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 23:23:39.946375 24127 ts_tablet_manager.cc:1905] T d826894952d94063b088a6012a5b9324 P 71350801cbc6438e98ddcdc7de6e4811: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260618 23:23:39.947921 24127 ts_tablet_manager.cc:1918] T d826894952d94063b088a6012a5b9324 P 71350801cbc6438e98ddcdc7de6e4811: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260618 23:23:39.948001 24127 log.cc:1196] T d826894952d94063b088a6012a5b9324 P 71350801cbc6438e98ddcdc7de6e4811: Deleting WAL directory at /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781824769284800-3942-0/minicluster-data/ts-2/wal/wals/d826894952d94063b088a6012a5b9324
I20260618 23:23:39.948247 24127 ts_tablet_manager.cc:1939] T d826894952d94063b088a6012a5b9324 P 71350801cbc6438e98ddcdc7de6e4811: Deleting consensus metadata
I20260618 23:23:39.948666 23623 catalog_manager.cc:4841] TS 71350801cbc6438e98ddcdc7de6e4811 (127.3.217.131:36963): tablet d826894952d94063b088a6012a5b9324 (table test-table [id=b6123ffff96443199fd6c9ed8b928973]) successfully deleted
W20260618 23:23:39.950098 23623 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.217.129:46005 (error 108)
I20260618 23:23:39.950273 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 23830
I20260618 23:23:39.951275 24101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:39.951139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.129:46005 (local address 127.0.0.1:48344)
0618 23:23:39.951201 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0618 23:23:39.951242 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.129:46005: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260618 23:23:39.951411 23623 catalog_manager.cc:4584] TS 0fa0b4dc9ed54a3a95d211e5900e52a1 (127.3.217.129:46005): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d826894952d94063b088a6012a5b9324: Network error: Client connection negotiation failed: client connection to 127.3.217.129:46005: connect: Connection refused (error 111)
I20260618 23:23:39.954574 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 23961
I20260618 23:23:39.958703 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 23608
2026-06-18T23:23:39Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (843 ms)
[----------] 6 tests from EncryptionPolicyTest (8626 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:23:40 dist-test-slave-r9ct krb5kdc[24131](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:23:40 dist-test-slave-r9ct krb5kdc[24131](info): set up 2 sockets
Jun 18 23:23:40 dist-test-slave-r9ct krb5kdc[24131](info): commencing operation
krb5kdc: starting...
W20260618 23:23:41.018831 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.041s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:23:41 dist-test-slave-r9ct krb5kdc[24131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:23:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:23:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260618 23:23:41.138552 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40957
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40957
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:41.218189 24144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:41.218376 24144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:41.218398 24144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:41.219547 24144 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:23:41.219587 24144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:41.219601 24144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:41.219614 24144 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:23:41.219625 24144 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:23:41.221056 24144 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40957
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40957
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24144
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:41.221302 24144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:41.221524 24144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:41.226257 24152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:41.226313 24149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:41.226330 24150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:41.226365 24144 server_base.cc:1034] running on GCE node
I20260618 23:23:41.226752 24144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:41.227052 24144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:41.228245 24144 hybrid_clock.cc:648] HybridClock initialized: now 1781825021228216 us; error 39 us; skew 500 ppm
Jun 18 23:23:41 dist-test-slave-r9ct krb5kdc[24131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825021, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:41.235592 24144 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260618 23:23:41.236045 24144 webserver.cc:460] Webserver started at http://127.0.0.1:43299/ using document root <none> and password file <none>
I20260618 23:23:41.236294 24144 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:41.236339 24144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:41.236485 24144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:41.237509 24144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "d683b2b04a064db7954889c9af13cf15"
format_stamp: "Formatted at 2026-06-18 23:23:41 on dist-test-slave-r9ct"
server_key: "86bc23e2989b8d48f6d4fddebf378dd7"
server_key_iv: "6f2efd3781d0d5eb7bbf54c962f49fbe"
server_key_version: "encryptionkey@0"
I20260618 23:23:41.237872 24144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "d683b2b04a064db7954889c9af13cf15"
format_stamp: "Formatted at 2026-06-18 23:23:41 on dist-test-slave-r9ct"
server_key: "86bc23e2989b8d48f6d4fddebf378dd7"
server_key_iv: "6f2efd3781d0d5eb7bbf54c962f49fbe"
server_key_version: "encryptionkey@0"
I20260618 23:23:41.239262 24144 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260618 23:23:41.240103 24159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:41.240329 24144 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:41.240417 24144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "d683b2b04a064db7954889c9af13cf15"
format_stamp: "Formatted at 2026-06-18 23:23:41 on dist-test-slave-r9ct"
server_key: "86bc23e2989b8d48f6d4fddebf378dd7"
server_key_iv: "6f2efd3781d0d5eb7bbf54c962f49fbe"
server_key_version: "encryptionkey@0"
I20260618 23:23:41.240480 24144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:41.264253 24144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:41.266423 24144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:41.266532 24144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:41.270237 24144 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40957
I20260618 23:23:41.270293 24211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40957 every 8 connection(s)
I20260618 23:23:41.270632 24144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:23:41.271693 24212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:41.273415 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 24144
I20260618 23:23:41.273504 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:23:41.273707 3942 external_mini_cluster.cc:1428] Setting key ac9609c8b2b1a762dcfed7f4951da7fd
I20260618 23:23:41.274075 24212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15: Bootstrap starting.
I20260618 23:23:41.274675 24212 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:41.274992 24212 log.cc:824] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:41.275637 24212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15: No bootstrap required, opened a new log
I20260618 23:23:41.277351 24212 raft_consensus.cc:348] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d683b2b04a064db7954889c9af13cf15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40957 } }
I20260618 23:23:41.277499 24212 raft_consensus.cc:374] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:41.277549 24212 raft_consensus.cc:729] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d683b2b04a064db7954889c9af13cf15, State: Initialized, Role: FOLLOWER
I20260618 23:23:41.277675 24212 consensus_queue.cc:260] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d683b2b04a064db7954889c9af13cf15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40957 } }
I20260618 23:23:41.277738 24212 raft_consensus.cc:388] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:23:41.277789 24212 raft_consensus.cc:482] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:23:41.277837 24212 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:41.278354 24212 raft_consensus.cc:504] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d683b2b04a064db7954889c9af13cf15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40957 } }
I20260618 23:23:41.278463 24212 leader_election.cc:302] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d683b2b04a064db7954889c9af13cf15; no voters:
I20260618 23:23:41.278622 24212 leader_election.cc:288] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:23:41.278690 24217 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:41.278877 24217 raft_consensus.cc:686] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15 [term 1 LEADER]: Becoming Leader. State: Replica: d683b2b04a064db7954889c9af13cf15, State: Running, Role: LEADER
I20260618 23:23:41.278930 24212 sys_catalog.cc:564] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:23:41.279040 24217 consensus_queue.cc:237] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d683b2b04a064db7954889c9af13cf15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40957 } }
I20260618 23:23:41.279443 24218 sys_catalog.cc:455] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d683b2b04a064db7954889c9af13cf15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d683b2b04a064db7954889c9af13cf15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40957 } } }
I20260618 23:23:41.279526 24218 sys_catalog.cc:458] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:41.279740 24219 sys_catalog.cc:455] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d683b2b04a064db7954889c9af13cf15. Latest consensus state: current_term: 1 leader_uuid: "d683b2b04a064db7954889c9af13cf15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d683b2b04a064db7954889c9af13cf15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40957 } } }
I20260618 23:23:41.280061 24219 sys_catalog.cc:458] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15 [sys.catalog]: This master's current role is: LEADER
Jun 18 23:23:41 dist-test-slave-r9ct krb5kdc[24131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
W20260618 23:23:41.280764 24233 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260618 23:23:41.280884 24233 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260618 23:23:41.280959 24224 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:23:41.281143 24224 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:23:41.282534 24224 catalog_manager.cc:1347] Generated new cluster ID: bb4ab07e4e984654860b9b150e220862
I20260618 23:23:41.282586 24224 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:23:41.285013 24215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:41.274222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46019 (local address 127.0.0.1:40957)
0618 23:23:41.274405 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:41.274412 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:41.274436 (+ 24us) server_negotiation.cc:407] Connection header received
0618 23:23:41.274954 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:41.274961 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:41.275006 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:41.275152 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:41.275828 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:41.276689 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:41.277539 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:41.278104 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:41.278221 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:41.281333 (+ 3112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:41.281337 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:41.281337 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:41.281349 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:41.283366 (+ 2017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:41.283800 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:41.283803 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:41.283803 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:41.283903 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:41.284135 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:41.284136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:41.284136 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:41.284448 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:41.284614 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:41.284703 (+ 89us) server_negotiation.cc:299] Negotiation successful
0618 23:23:41.284801 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":102,"threads_started":1}
I20260618 23:23:41.285864 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:23:41.289485 24224 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:23:41.290154 24224 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:23:41.294381 24215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:41.287530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57249 (local address 127.0.0.1:40957)
0618 23:23:41.287559 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:41.287561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:41.287568 (+ 7us) server_negotiation.cc:407] Connection header received
0618 23:23:41.287611 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:41.287612 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:41.287621 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:41.287671 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:41.288306 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:41.289015 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:41.290039 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:41.290333 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:41.290372 (+ 39us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:41.291807 (+ 1435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:41.291809 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:41.291809 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:41.291815 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:41.293272 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:41.293630 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:41.293631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:41.293631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:41.293672 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:41.293875 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:41.293875 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:41.293876 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:41.293973 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:41.294051 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:41.294244 (+ 193us) server_negotiation.cc:299] Negotiation successful
0618 23:23:41.294299 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260618 23:23:41.303813 24224 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d683b2b04a064db7954889c9af13cf15: Generated new TSK 0
I20260618 23:23:41.303995 24224 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:23:41.305763 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 24144
W20260618 23:23:41.310127 24129 connection.cc:535] client connection to 127.0.0.1:40957 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40957): Connection reset by peer (error 104)
2026-06-18T23:23:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1345 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:23:41 dist-test-slave-r9ct krb5kdc[24243](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:23:41 dist-test-slave-r9ct krb5kdc[24243](info): set up 2 sockets
Jun 18 23:23:41 dist-test-slave-r9ct krb5kdc[24243](info): commencing operation
krb5kdc: starting...
W20260618 23:23:42.358863 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.035s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:23:42 dist-test-slave-r9ct krb5kdc[24243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:23:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:23:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260618 23:23:42.490418 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45687
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:42.571350 24256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:42.571559 24256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:42.571581 24256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:42.572644 24256 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:23:42.572683 24256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:42.572698 24256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:42.572710 24256 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:23:42.572722 24256 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:23:42.574116 24256 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45687
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:42.574312 24256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:42.574479 24256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:42.579578 24264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:42.579578 24262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:42.579763 24261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:42.579733 24256 server_base.cc:1034] running on GCE node
I20260618 23:23:42.580053 24256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:42.580330 24256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:42.581482 24256 hybrid_clock.cc:648] HybridClock initialized: now 1781825022581447 us; error 49 us; skew 500 ppm
Jun 18 23:23:42 dist-test-slave-r9ct krb5kdc[24243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825022, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:42.584857 24256 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260618 23:23:42.585417 24256 webserver.cc:460] Webserver started at http://127.0.0.1:41009/ using document root <none> and password file <none>
I20260618 23:23:42.585696 24256 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:42.585763 24256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:42.585914 24256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:42.587265 24256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "dc0baa5038a0405c9a3477adf42642c3"
format_stamp: "Formatted at 2026-06-18 23:23:42 on dist-test-slave-r9ct"
server_key: "4ee91703389ed0517b80e9ff204bf378"
server_key_iv: "c2595381d2586cc8fa70b0c3fae32a5f"
server_key_version: "encryptionkey@0"
I20260618 23:23:42.587651 24256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "dc0baa5038a0405c9a3477adf42642c3"
format_stamp: "Formatted at 2026-06-18 23:23:42 on dist-test-slave-r9ct"
server_key: "4ee91703389ed0517b80e9ff204bf378"
server_key_iv: "c2595381d2586cc8fa70b0c3fae32a5f"
server_key_version: "encryptionkey@0"
I20260618 23:23:42.589504 24256 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260618 23:23:42.590341 24271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:42.590552 24256 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:42.590670 24256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "dc0baa5038a0405c9a3477adf42642c3"
format_stamp: "Formatted at 2026-06-18 23:23:42 on dist-test-slave-r9ct"
server_key: "4ee91703389ed0517b80e9ff204bf378"
server_key_iv: "c2595381d2586cc8fa70b0c3fae32a5f"
server_key_version: "encryptionkey@0"
I20260618 23:23:42.590824 24256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:42.610289 24256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:42.612452 24256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:42.612567 24256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:42.617079 24256 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45687
I20260618 23:23:42.617152 24323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45687 every 8 connection(s)
I20260618 23:23:42.617483 24256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:23:42.618459 24324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:42.620689 24324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3: Bootstrap starting.
I20260618 23:23:42.621261 24324 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:42.621547 24324 log.cc:824] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:42.622223 24324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3: No bootstrap required, opened a new log
I20260618 23:23:42.623862 24324 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc0baa5038a0405c9a3477adf42642c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45687 } }
I20260618 23:23:42.623993 24324 raft_consensus.cc:374] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:42.624014 24324 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc0baa5038a0405c9a3477adf42642c3, State: Initialized, Role: FOLLOWER
I20260618 23:23:42.624184 24324 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc0baa5038a0405c9a3477adf42642c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45687 } }
I20260618 23:23:42.624256 24324 raft_consensus.cc:388] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:23:42.624287 24324 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:23:42.624327 24324 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:42.624852 24324 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc0baa5038a0405c9a3477adf42642c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45687 } }
I20260618 23:23:42.624938 24324 leader_election.cc:302] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc0baa5038a0405c9a3477adf42642c3; no voters:
I20260618 23:23:42.625106 24324 leader_election.cc:288] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:23:42.625249 24327 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:42.625547 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 24256
I20260618 23:23:42.625393 24324 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:23:42.625669 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:23:42.625761 24327 raft_consensus.cc:686] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3 [term 1 LEADER]: Becoming Leader. State: Replica: dc0baa5038a0405c9a3477adf42642c3, State: Running, Role: LEADER
I20260618 23:23:42.625931 3942 external_mini_cluster.cc:1428] Setting key 64c33d2912b4fa7b51aac3d50a61d952
I20260618 23:23:42.625875 24327 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc0baa5038a0405c9a3477adf42642c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45687 } }
I20260618 23:23:42.626636 24329 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc0baa5038a0405c9a3477adf42642c3. Latest consensus state: current_term: 1 leader_uuid: "dc0baa5038a0405c9a3477adf42642c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc0baa5038a0405c9a3477adf42642c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45687 } } }
I20260618 23:23:42.626755 24329 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:42.627132 24328 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc0baa5038a0405c9a3477adf42642c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc0baa5038a0405c9a3477adf42642c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45687 } } }
I20260618 23:23:42.627204 24328 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3 [sys.catalog]: This master's current role is: LEADER
W20260618 23:23:42.627849 24345 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260618 23:23:42.627907 24345 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260618 23:23:42.627956 24338 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:23:42.628098 24338 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:23:42.629693 24338 catalog_manager.cc:1347] Generated new cluster ID: 1379b2027f00478fb47780b801b0b276
I20260618 23:23:42.629756 24338 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:23:42.633623 24337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:42.626658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50797 (local address 127.0.0.1:45687)
0618 23:23:42.626865 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:42.626875 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:42.627755 (+ 880us) server_negotiation.cc:407] Connection header received
0618 23:23:42.627886 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:42.627893 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:42.627953 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:42.628105 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:42.628401 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:42.629666 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:42.630795 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:42.631575 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:42.631738 (+ 163us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:42.632880 (+ 1142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:42.632885 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:42.632885 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:42.633091 (+ 206us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:42.633131 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:42.633146 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:42.633228 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:42.633337 (+ 109us) server_negotiation.cc:299] Negotiation successful
0618 23:23:42.633367 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":104,"threads_started":1}
I20260618 23:23:42.634909 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:23:42.639288 24338 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:23:42.640057 24338 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:23:42.640189 24337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:42.636479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50401 (local address 127.0.0.1:45687)
0618 23:23:42.636559 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:42.636562 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:42.636748 (+ 186us) server_negotiation.cc:407] Connection header received
0618 23:23:42.636779 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:42.636780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:42.636790 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:42.636858 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:42.636978 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:42.637716 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:42.638685 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:42.639003 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:42.639075 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:42.639918 (+ 843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:42.639919 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:42.639919 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:42.639924 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:42.639938 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:42.639943 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:42.640005 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:42.640091 (+ 86us) server_negotiation.cc:299] Negotiation successful
0618 23:23:42.640103 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260618 23:23:42.645416 24338 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dc0baa5038a0405c9a3477adf42642c3: Generated new TSK 0
I20260618 23:23:42.645576 24338 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:23:42.653878 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 24256
W20260618 23:23:42.658181 24241 connection.cc:535] client connection to 127.0.0.1:45687 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45687): Connection reset by peer (error 104)
2026-06-18T23:23:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1347 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:23:42 dist-test-slave-r9ct krb5kdc[24355](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:23:42 dist-test-slave-r9ct krb5kdc[24355](info): set up 2 sockets
Jun 18 23:23:42 dist-test-slave-r9ct krb5kdc[24355](info): commencing operation
krb5kdc: starting...
W20260618 23:23:43.710685 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.039s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:23:43 dist-test-slave-r9ct krb5kdc[24355](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:23:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:23:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260618 23:23:43.829254 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40449
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40449
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:43.906903 24368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:43.907085 24368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:43.907107 24368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:43.908138 24368 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:23:43.908170 24368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:43.908183 24368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:43.908196 24368 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:23:43.908208 24368 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:23:43.909552 24368 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40449
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24368
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:43.909723 24368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:43.909884 24368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:43.914556 24376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:43.914556 24373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:43.914535 24374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:43.914574 24368 server_base.cc:1034] running on GCE node
I20260618 23:23:43.915023 24368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:43.915298 24368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:43.916494 24368 hybrid_clock.cc:648] HybridClock initialized: now 1781825023916471 us; error 53 us; skew 500 ppm
Jun 18 23:23:43 dist-test-slave-r9ct krb5kdc[24355](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825023, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:43.918970 24368 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260618 23:23:43.919380 24368 webserver.cc:460] Webserver started at http://127.0.0.1:35211/ using document root <none> and password file <none>
I20260618 23:23:43.919616 24368 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:43.919684 24368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:43.919833 24368 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:43.920800 24368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "2219cc05cf154ae5b54399248c7708f8"
format_stamp: "Formatted at 2026-06-18 23:23:43 on dist-test-slave-r9ct"
server_key: "4b922c43e032d0a9645dd7dfcb60796a"
server_key_iv: "a23a9eaa67c97b1e6cfd0f6c438af285"
server_key_version: "encryptionkey@0"
I20260618 23:23:43.921135 24368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "2219cc05cf154ae5b54399248c7708f8"
format_stamp: "Formatted at 2026-06-18 23:23:43 on dist-test-slave-r9ct"
server_key: "4b922c43e032d0a9645dd7dfcb60796a"
server_key_iv: "a23a9eaa67c97b1e6cfd0f6c438af285"
server_key_version: "encryptionkey@0"
I20260618 23:23:43.922420 24368 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260618 23:23:43.923233 24383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:43.923457 24368 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260618 23:23:43.923563 24368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "2219cc05cf154ae5b54399248c7708f8"
format_stamp: "Formatted at 2026-06-18 23:23:43 on dist-test-slave-r9ct"
server_key: "4b922c43e032d0a9645dd7dfcb60796a"
server_key_iv: "a23a9eaa67c97b1e6cfd0f6c438af285"
server_key_version: "encryptionkey@0"
I20260618 23:23:43.923641 24368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:43.926784 24368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:43.928960 24368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:43.929111 24368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:43.932906 24368 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40449
I20260618 23:23:43.932934 24435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40449 every 8 connection(s)
I20260618 23:23:43.933235 24368 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:23:43.933735 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 24368
I20260618 23:23:43.933883 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:23:43.934113 3942 external_mini_cluster.cc:1428] Setting key 61b80669ca18fa834e77fdf5e14a5340
I20260618 23:23:43.934470 24436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:43.936372 24439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:43.934593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59795 (local address 127.0.0.1:40449)
0618 23:23:43.934782 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:43.934788 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:43.934811 (+ 23us) server_negotiation.cc:407] Connection header received
0618 23:23:43.935187 (+ 376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:43.935192 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:43.935215 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:43.935326 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:43.935913 (+ 587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:43.935916 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:43.935916 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:43.935919 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:43.935951 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:43.935960 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:43.936022 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:43.936099 (+ 77us) server_negotiation.cc:299] Negotiation successful
0618 23:23:43.936127 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":90,"threads_started":1}
I20260618 23:23:43.937274 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:23:43.937844 24436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8: Bootstrap starting.
I20260618 23:23:43.938553 24436 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:43.938920 24436 log.cc:824] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:43.939601 24436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8: No bootstrap required, opened a new log
I20260618 23:23:43.940034 24439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:43.938972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41571 (local address 127.0.0.1:40449)
0618 23:23:43.939012 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:43.939014 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:43.939140 (+ 126us) server_negotiation.cc:407] Connection header received
0618 23:23:43.939212 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:43.939213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:43.939217 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:43.939266 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:43.939829 (+ 563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:43.939830 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:43.939830 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:43.939833 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:43.939844 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:43.939848 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:43.939892 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:43.939946 (+ 54us) server_negotiation.cc:299] Negotiation successful
0618 23:23:43.939955 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260618 23:23:43.941550 24436 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2219cc05cf154ae5b54399248c7708f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40449 } }
I20260618 23:23:43.941717 24436 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:43.941758 24436 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2219cc05cf154ae5b54399248c7708f8, State: Initialized, Role: FOLLOWER
I20260618 23:23:43.941875 24436 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2219cc05cf154ae5b54399248c7708f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40449 } }
I20260618 23:23:43.941965 24436 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:23:43.942031 24436 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:23:43.942078 24436 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:43.942570 24436 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2219cc05cf154ae5b54399248c7708f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40449 } }
I20260618 23:23:43.942675 24436 leader_election.cc:302] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2219cc05cf154ae5b54399248c7708f8; no voters:
I20260618 23:23:43.942854 24436 leader_election.cc:288] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:23:43.942915 24446 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:43.943051 24446 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8 [term 1 LEADER]: Becoming Leader. State: Replica: 2219cc05cf154ae5b54399248c7708f8, State: Running, Role: LEADER
I20260618 23:23:43.943090 24436 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:23:43.943182 24446 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2219cc05cf154ae5b54399248c7708f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40449 } }
I20260618 23:23:43.943548 24447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2219cc05cf154ae5b54399248c7708f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2219cc05cf154ae5b54399248c7708f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40449 } } }
I20260618 23:23:43.943557 24448 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2219cc05cf154ae5b54399248c7708f8. Latest consensus state: current_term: 1 leader_uuid: "2219cc05cf154ae5b54399248c7708f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2219cc05cf154ae5b54399248c7708f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40449 } } }
I20260618 23:23:43.943728 24447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:43.943738 24448 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:43.944109 24455 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:23:43.944597 24455 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:23:43.945998 24455 catalog_manager.cc:1347] Generated new cluster ID: feae057690e44eae91fb4d95877f3186
I20260618 23:23:43.946046 24455 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:23:43.953773 24455 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:23:43.953935 24455 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:23:43.960244 24455 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2219cc05cf154ae5b54399248c7708f8: Generated new TSK 0
I20260618 23:23:43.960464 24455 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:23:43.971334 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 24368
2026-06-18T23:23:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1317 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:23:44 dist-test-slave-r9ct krb5kdc[24467](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:23:44 dist-test-slave-r9ct krb5kdc[24467](info): set up 2 sockets
Jun 18 23:23:44 dist-test-slave-r9ct krb5kdc[24467](info): commencing operation
krb5kdc: starting...
W20260618 23:23:45.042685 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.054s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:23:45 dist-test-slave-r9ct krb5kdc[24467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825025, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:23:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:23:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260618 23:23:45.166860 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35027
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35027
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:45.250856 24480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:45.251060 24480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:45.251082 24480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:45.252302 24480 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:23:45.252341 24480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:45.252357 24480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:45.252368 24480 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:23:45.252380 24480 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:23:45.253893 24480 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35027
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35027
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24480
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:45.254128 24480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:45.254390 24480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:45.259095 24485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:45.259109 24486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:45.259109 24488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:45.259428 24480 server_base.cc:1034] running on GCE node
I20260618 23:23:45.259645 24480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:45.259913 24480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:45.261096 24480 hybrid_clock.cc:648] HybridClock initialized: now 1781825025261087 us; error 51 us; skew 500 ppm
Jun 18 23:23:45 dist-test-slave-r9ct krb5kdc[24467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825025, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:45.263720 24480 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260618 23:23:45.264165 24480 webserver.cc:460] Webserver started at http://127.0.0.1:40043/ using document root <none> and password file <none>
I20260618 23:23:45.264407 24480 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:45.264474 24480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:45.264622 24480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:45.265676 24480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "b9ca1d06d10a476c8c22649e92fe5282"
format_stamp: "Formatted at 2026-06-18 23:23:45 on dist-test-slave-r9ct"
server_key: "7555b44192706e0a33e9db47b0aab77c"
server_key_iv: "a777829c5be2072fb0cea4c140ef2234"
server_key_version: "encryptionkey@0"
I20260618 23:23:45.266023 24480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "b9ca1d06d10a476c8c22649e92fe5282"
format_stamp: "Formatted at 2026-06-18 23:23:45 on dist-test-slave-r9ct"
server_key: "7555b44192706e0a33e9db47b0aab77c"
server_key_iv: "a777829c5be2072fb0cea4c140ef2234"
server_key_version: "encryptionkey@0"
I20260618 23:23:45.267381 24480 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260618 23:23:45.268100 24495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:45.268273 24480 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260618 23:23:45.268368 24480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "b9ca1d06d10a476c8c22649e92fe5282"
format_stamp: "Formatted at 2026-06-18 23:23:45 on dist-test-slave-r9ct"
server_key: "7555b44192706e0a33e9db47b0aab77c"
server_key_iv: "a777829c5be2072fb0cea4c140ef2234"
server_key_version: "encryptionkey@0"
I20260618 23:23:45.268443 24480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:45.280335 24480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:45.282095 24480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:45.282315 24480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:45.286397 24480 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35027
I20260618 23:23:45.286433 24547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35027 every 8 connection(s)
I20260618 23:23:45.286851 24480 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:23:45.287968 24548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:45.290133 24548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282: Bootstrap starting.
I20260618 23:23:45.290634 24548 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:45.290926 24548 log.cc:824] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:45.291558 24548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282: No bootstrap required, opened a new log
I20260618 23:23:45.292577 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 24480
I20260618 23:23:45.292676 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:23:45.292910 3942 external_mini_cluster.cc:1428] Setting key 5f7f9e6bb85a442019c3f16d9a809d56
I20260618 23:23:45.293206 24548 raft_consensus.cc:348] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9ca1d06d10a476c8c22649e92fe5282" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35027 } }
I20260618 23:23:45.293418 24548 raft_consensus.cc:374] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:45.293484 24548 raft_consensus.cc:729] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9ca1d06d10a476c8c22649e92fe5282, State: Initialized, Role: FOLLOWER
I20260618 23:23:45.293612 24548 consensus_queue.cc:260] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9ca1d06d10a476c8c22649e92fe5282" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35027 } }
I20260618 23:23:45.293704 24548 raft_consensus.cc:388] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:23:45.293737 24548 raft_consensus.cc:482] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:23:45.293792 24548 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:45.294523 24548 raft_consensus.cc:504] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9ca1d06d10a476c8c22649e92fe5282" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35027 } }
I20260618 23:23:45.294637 24548 leader_election.cc:302] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b9ca1d06d10a476c8c22649e92fe5282; no voters:
I20260618 23:23:45.294831 24548 leader_election.cc:288] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:23:45.294981 24554 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:45.295079 24548 sys_catalog.cc:564] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:23:45.295137 24554 raft_consensus.cc:686] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282 [term 1 LEADER]: Becoming Leader. State: Replica: b9ca1d06d10a476c8c22649e92fe5282, State: Running, Role: LEADER
I20260618 23:23:45.295236 24554 consensus_queue.cc:237] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9ca1d06d10a476c8c22649e92fe5282" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35027 } }
I20260618 23:23:45.295573 24553 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b9ca1d06d10a476c8c22649e92fe5282" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9ca1d06d10a476c8c22649e92fe5282" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35027 } } }
I20260618 23:23:45.295660 24553 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:45.295903 24555 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b9ca1d06d10a476c8c22649e92fe5282. Latest consensus state: current_term: 1 leader_uuid: "b9ca1d06d10a476c8c22649e92fe5282" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9ca1d06d10a476c8c22649e92fe5282" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35027 } } }
I20260618 23:23:45.296027 24555 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:45.296195 24561 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:23:45.296731 24561 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:23:45.298867 24561 catalog_manager.cc:1347] Generated new cluster ID: 4290a6bd8a024057a812a0cc75adcd26
I20260618 23:23:45.298923 24561 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 18 23:23:45 dist-test-slave-r9ct krb5kdc[24467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825025, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260618 23:23:45.305210 24552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:45.293447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40351 (local address 127.0.0.1:35027)
0618 23:23:45.293674 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:45.293682 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:45.293731 (+ 49us) server_negotiation.cc:407] Connection header received
0618 23:23:45.293871 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:45.293877 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:45.293929 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:45.294041 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:45.295006 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:45.296507 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:45.297897 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:45.298455 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:45.298569 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:45.301389 (+ 2820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:45.301393 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:45.301393 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:45.301404 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:45.303445 (+ 2041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:45.303848 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:45.303851 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:45.303852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:45.303977 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:45.304201 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:45.304201 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:45.304202 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:45.304494 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:45.304645 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:45.304772 (+ 127us) server_negotiation.cc:299] Negotiation successful
0618 23:23:45.305005 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":104,"threads_started":1}
I20260618 23:23:45.306134 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:23:45.314698 24552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:45.307614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50961 (local address 127.0.0.1:35027)
0618 23:23:45.307650 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:45.307652 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:45.307773 (+ 121us) server_negotiation.cc:407] Connection header received
0618 23:23:45.307819 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:45.307820 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:45.307830 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:45.307897 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:45.308508 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:45.309242 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:45.310256 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:45.310563 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:45.310632 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:45.311940 (+ 1308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:45.311942 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:45.311942 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:45.311948 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:45.313528 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:45.313938 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:45.313939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:45.313940 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:45.313995 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:45.314197 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:45.314198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:45.314198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:45.314315 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:45.314407 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:45.314534 (+ 127us) server_negotiation.cc:299] Negotiation successful
0618 23:23:45.314604 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260618 23:23:45.324681 24561 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:23:45.325184 24561 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:23:45.331766 24561 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b9ca1d06d10a476c8c22649e92fe5282: Generated new TSK 0
I20260618 23:23:45.331939 24561 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:23:45.339915 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 24480
2026-06-18T23:23:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1368 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:23:45 dist-test-slave-r9ct krb5kdc[24579](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:23:45 dist-test-slave-r9ct krb5kdc[24579](info): set up 2 sockets
Jun 18 23:23:45 dist-test-slave-r9ct krb5kdc[24579](info): commencing operation
krb5kdc: starting...
W20260618 23:23:46.383033 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.025s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:23:46 dist-test-slave-r9ct krb5kdc[24579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:23:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:23:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260618 23:23:46.501905 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35619
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35619
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:46.583122 24592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:46.583381 24592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:46.583418 24592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:46.584535 24592 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:23:46.584609 24592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:46.584638 24592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:46.584671 24592 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:23:46.584693 24592 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:23:46.586153 24592 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35619
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:46.586421 24592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:46.586640 24592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:46.591703 24600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:46.591683 24597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:46.591715 24598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:46.591686 24592 server_base.cc:1034] running on GCE node
I20260618 23:23:46.592123 24592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:46.592386 24592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:46.593554 24592 hybrid_clock.cc:648] HybridClock initialized: now 1781825026593546 us; error 31 us; skew 500 ppm
Jun 18 23:23:46 dist-test-slave-r9ct krb5kdc[24579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825026, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:46.600646 24592 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260618 23:23:46.601114 24592 webserver.cc:460] Webserver started at http://127.0.0.1:44519/ using document root <none> and password file <none>
I20260618 23:23:46.601347 24592 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:46.601418 24592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:46.601567 24592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:46.602578 24592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "cad6f12b769240ada0fe11b61a12c483"
format_stamp: "Formatted at 2026-06-18 23:23:46 on dist-test-slave-r9ct"
server_key: "7501873604e4e56dc07a4fe010c34739"
server_key_iv: "1d28b9bbf64fe9442b452b1019295a43"
server_key_version: "encryptionkey@0"
I20260618 23:23:46.602964 24592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "cad6f12b769240ada0fe11b61a12c483"
format_stamp: "Formatted at 2026-06-18 23:23:46 on dist-test-slave-r9ct"
server_key: "7501873604e4e56dc07a4fe010c34739"
server_key_iv: "1d28b9bbf64fe9442b452b1019295a43"
server_key_version: "encryptionkey@0"
I20260618 23:23:46.604247 24592 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:46.605010 24607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:46.605227 24592 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:46.605329 24592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "cad6f12b769240ada0fe11b61a12c483"
format_stamp: "Formatted at 2026-06-18 23:23:46 on dist-test-slave-r9ct"
server_key: "7501873604e4e56dc07a4fe010c34739"
server_key_iv: "1d28b9bbf64fe9442b452b1019295a43"
server_key_version: "encryptionkey@0"
I20260618 23:23:46.605412 24592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:46.619455 24592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:46.621420 24592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:46.621579 24592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:46.625680 24592 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35619
I20260618 23:23:46.625712 24659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35619 every 8 connection(s)
I20260618 23:23:46.626055 24592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:23:46.626838 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 24592
I20260618 23:23:46.626972 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:23:46.627230 3942 external_mini_cluster.cc:1428] Setting key 5f2bad1c2ececf47ea5065ca3ae96d13
I20260618 23:23:46.627810 24660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:46.630864 24660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483: Bootstrap starting.
I20260618 23:23:46.631512 24660 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:46.631829 24660 log.cc:824] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:46.632553 24660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483: No bootstrap required, opened a new log
I20260618 23:23:46.632829 24663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:46.627845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36379 (local address 127.0.0.1:35619)
0618 23:23:46.628019 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:46.628026 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:46.628050 (+ 24us) server_negotiation.cc:407] Connection header received
0618 23:23:46.628468 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:46.628473 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:46.628515 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:46.628625 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:46.628864 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:46.629735 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:46.630878 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:46.631359 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:46.631447 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:46.632185 (+ 738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:46.632189 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:46.632189 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:46.632357 (+ 168us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:46.632385 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:46.632395 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:46.632469 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:46.632551 (+ 82us) server_negotiation.cc:299] Negotiation successful
0618 23:23:46.632618 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":91,"threads_started":1}
I20260618 23:23:46.634442 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:23:46.634439 24660 raft_consensus.cc:348] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cad6f12b769240ada0fe11b61a12c483" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35619 } }
I20260618 23:23:46.634618 24660 raft_consensus.cc:374] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:46.634668 24660 raft_consensus.cc:729] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cad6f12b769240ada0fe11b61a12c483, State: Initialized, Role: FOLLOWER
I20260618 23:23:46.634794 24660 consensus_queue.cc:260] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cad6f12b769240ada0fe11b61a12c483" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35619 } }
I20260618 23:23:46.634886 24660 raft_consensus.cc:388] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:23:46.634982 24660 raft_consensus.cc:482] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:23:46.635066 24660 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:46.635761 24660 raft_consensus.cc:504] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cad6f12b769240ada0fe11b61a12c483" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35619 } }
I20260618 23:23:46.635876 24660 leader_election.cc:302] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cad6f12b769240ada0fe11b61a12c483; no voters:
I20260618 23:23:46.636044 24660 leader_election.cc:288] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:23:46.636077 24670 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:46.636178 24670 raft_consensus.cc:686] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483 [term 1 LEADER]: Becoming Leader. State: Replica: cad6f12b769240ada0fe11b61a12c483, State: Running, Role: LEADER
I20260618 23:23:46.636286 24660 sys_catalog.cc:564] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:23:46.636307 24670 consensus_queue.cc:237] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cad6f12b769240ada0fe11b61a12c483" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35619 } }
I20260618 23:23:46.636608 24670 sys_catalog.cc:455] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cad6f12b769240ada0fe11b61a12c483" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cad6f12b769240ada0fe11b61a12c483" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35619 } } }
I20260618 23:23:46.636684 24670 sys_catalog.cc:458] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:46.636818 24670 sys_catalog.cc:455] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cad6f12b769240ada0fe11b61a12c483. Latest consensus state: current_term: 1 leader_uuid: "cad6f12b769240ada0fe11b61a12c483" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cad6f12b769240ada0fe11b61a12c483" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35619 } } }
I20260618 23:23:46.636891 24670 sys_catalog.cc:458] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:46.637686 24675 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:23:46.638200 24675 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:23:46.639555 24663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:46.635949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37789 (local address 127.0.0.1:35619)
0618 23:23:46.635982 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:46.635984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:46.636155 (+ 171us) server_negotiation.cc:407] Connection header received
0618 23:23:46.636177 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:46.636178 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:46.636189 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:46.636272 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:46.636406 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:46.637103 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:46.638143 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:46.638448 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:46.638539 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:46.639301 (+ 762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:46.639303 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:46.639303 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:46.639308 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:46.639320 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:46.639325 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:46.639378 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:46.639439 (+ 61us) server_negotiation.cc:299] Negotiation successful
0618 23:23:46.639461 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260618 23:23:46.639904 24675 catalog_manager.cc:1347] Generated new cluster ID: 55e3d83739f94cc3b7cf229695a4bb17
I20260618 23:23:46.639950 24675 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:23:46.650274 24675 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:23:46.651010 24675 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:23:46.662919 24675 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cad6f12b769240ada0fe11b61a12c483: Generated new TSK 0
I20260618 23:23:46.663101 24675 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:23:46.675145 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 24592
2026-06-18T23:23:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1334 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:23:46 dist-test-slave-r9ct krb5kdc[24691](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:23:46 dist-test-slave-r9ct krb5kdc[24691](info): set up 2 sockets
Jun 18 23:23:46 dist-test-slave-r9ct krb5kdc[24691](info): commencing operation
krb5kdc: starting...
W20260618 23:23:47.755004 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:23:47 dist-test-slave-r9ct krb5kdc[24691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:23:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:23:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260618 23:23:47.882385 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32937
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32937
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:47.959429 24704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:47.959690 24704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:47.959728 24704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:47.960822 24704 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:23:47.960897 24704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:47.960923 24704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:47.960950 24704 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:23:47.960981 24704 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:23:47.962383 24704 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32937
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24704
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:47.962649 24704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:47.962888 24704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:47.967473 24709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:47.967928 24710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:47.968359 24704 server_base.cc:1034] running on GCE node
W20260618 23:23:47.968367 24712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:47.968636 24704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:47.968940 24704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:47.970120 24704 hybrid_clock.cc:648] HybridClock initialized: now 1781825027970089 us; error 49 us; skew 500 ppm
Jun 18 23:23:47 dist-test-slave-r9ct krb5kdc[24691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825027, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:47.973023 24704 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260618 23:23:47.973496 24704 webserver.cc:460] Webserver started at http://127.0.0.1:39369/ using document root <none> and password file <none>
I20260618 23:23:47.973764 24704 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:47.973840 24704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:47.974004 24704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:47.975183 24704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "04ec1c489bd04ee08f13d9db6453d7ff"
format_stamp: "Formatted at 2026-06-18 23:23:47 on dist-test-slave-r9ct"
server_key: "fa22955a95128f6a23200fe79607d255"
server_key_iv: "07bd90d64a228b14dd31126a11ab17dd"
server_key_version: "encryptionkey@0"
I20260618 23:23:47.975646 24704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "04ec1c489bd04ee08f13d9db6453d7ff"
format_stamp: "Formatted at 2026-06-18 23:23:47 on dist-test-slave-r9ct"
server_key: "fa22955a95128f6a23200fe79607d255"
server_key_iv: "07bd90d64a228b14dd31126a11ab17dd"
server_key_version: "encryptionkey@0"
I20260618 23:23:47.977524 24704 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260618 23:23:47.978323 24719 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:47.978516 24704 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:47.978611 24704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "04ec1c489bd04ee08f13d9db6453d7ff"
format_stamp: "Formatted at 2026-06-18 23:23:47 on dist-test-slave-r9ct"
server_key: "fa22955a95128f6a23200fe79607d255"
server_key_iv: "07bd90d64a228b14dd31126a11ab17dd"
server_key_version: "encryptionkey@0"
I20260618 23:23:47.978700 24704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:47.981892 24704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:47.984145 24704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:47.984308 24704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:47.988436 24704 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32937
I20260618 23:23:47.988472 24771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32937 every 8 connection(s)
I20260618 23:23:47.988782 24704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:23:47.989787 24772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:47.992020 24772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff: Bootstrap starting.
I20260618 23:23:47.992578 24772 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:47.992861 24772 log.cc:824] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:47.993530 24772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff: No bootstrap required, opened a new log
I20260618 23:23:47.995087 24772 raft_consensus.cc:348] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04ec1c489bd04ee08f13d9db6453d7ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32937 } }
I20260618 23:23:47.995219 24772 raft_consensus.cc:374] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:47.995241 24772 raft_consensus.cc:729] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04ec1c489bd04ee08f13d9db6453d7ff, State: Initialized, Role: FOLLOWER
I20260618 23:23:47.995379 24772 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04ec1c489bd04ee08f13d9db6453d7ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32937 } }
I20260618 23:23:47.995452 24772 raft_consensus.cc:388] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:23:47.995474 24772 raft_consensus.cc:482] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:23:47.995501 24772 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:47.995971 24772 raft_consensus.cc:504] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04ec1c489bd04ee08f13d9db6453d7ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32937 } }
I20260618 23:23:47.996057 24772 leader_election.cc:302] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 04ec1c489bd04ee08f13d9db6453d7ff; no voters:
I20260618 23:23:47.996199 24772 leader_election.cc:288] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:23:47.996228 24775 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:47.996343 24775 raft_consensus.cc:686] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff [term 1 LEADER]: Becoming Leader. State: Replica: 04ec1c489bd04ee08f13d9db6453d7ff, State: Running, Role: LEADER
I20260618 23:23:47.996411 24775 consensus_queue.cc:237] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04ec1c489bd04ee08f13d9db6453d7ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32937 } }
I20260618 23:23:47.996467 24772 sys_catalog.cc:564] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:23:47.996721 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 24704
I20260618 23:23:47.996840 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:23:47.996996 3942 external_mini_cluster.cc:1428] Setting key d008bf70bf38a540090a25cdbc2df87f
I20260618 23:23:47.996729 24775 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04ec1c489bd04ee08f13d9db6453d7ff. Latest consensus state: current_term: 1 leader_uuid: "04ec1c489bd04ee08f13d9db6453d7ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04ec1c489bd04ee08f13d9db6453d7ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32937 } } }
I20260618 23:23:47.997236 24775 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:47.996891 24776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "04ec1c489bd04ee08f13d9db6453d7ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04ec1c489bd04ee08f13d9db6453d7ff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32937 } } }
I20260618 23:23:47.997638 24776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:47.997960 24780 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:23:47.998888 24780 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:23:47.999495 24784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:47.997624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49949 (local address 127.0.0.1:32937)
0618 23:23:47.997796 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:47.997805 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:47.997853 (+ 48us) server_negotiation.cc:407] Connection header received
0618 23:23:47.997982 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:47.997988 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:47.998017 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:47.998164 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:47.998866 (+ 702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:47.998870 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:47.998870 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:47.998875 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:47.998923 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:47.998938 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:47.998997 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:47.999277 (+ 280us) server_negotiation.cc:299] Negotiation successful
0618 23:23:47.999319 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":65,"threads_started":1}
I20260618 23:23:48.000645 24780 catalog_manager.cc:1347] Generated new cluster ID: eb122b6992744db2b29964691eccf647
I20260618 23:23:48.000730 24780 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:23:48.000784 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:23:48.003141 24784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:48.002170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59065 (local address 127.0.0.1:32937)
0618 23:23:48.002205 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:48.002207 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:48.002215 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:23:48.002286 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:48.002287 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:48.002291 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:48.002345 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:48.002927 (+ 582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:48.002928 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:48.002929 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:48.002933 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:48.002947 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:48.002951 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:48.003007 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:48.003053 (+ 46us) server_negotiation.cc:299] Negotiation successful
0618 23:23:48.003068 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260618 23:23:48.027746 24780 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:23:48.027942 24780 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:23:48.032888 24780 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 04ec1c489bd04ee08f13d9db6453d7ff: Generated new TSK 0
I20260618 23:23:48.033073 24780 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:23:48.038355 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 24704
2026-06-18T23:23:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1363 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:23:48 dist-test-slave-r9ct krb5kdc[24803](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:23:48 dist-test-slave-r9ct krb5kdc[24803](info): set up 2 sockets
Jun 18 23:23:48 dist-test-slave-r9ct krb5kdc[24803](info): commencing operation
krb5kdc: starting...
W20260618 23:23:49.090927 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.034s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:23:49 dist-test-slave-r9ct krb5kdc[24803](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:23:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:23:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260618 23:23:49.219024 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33475
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33475
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:49.299093 24816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:49.299346 24816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:49.299383 24816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:49.300526 24816 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:23:49.300603 24816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:49.300626 24816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:49.300648 24816 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:23:49.300678 24816 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:23:49.302184 24816 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33475
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24816
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:49.302486 24816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:49.302744 24816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:49.308430 24822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:49.308432 24821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:49.308521 24824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:49.308769 24816 server_base.cc:1034] running on GCE node
I20260618 23:23:49.309197 24816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:49.309671 24816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:49.310909 24816 hybrid_clock.cc:648] HybridClock initialized: now 1781825029310880 us; error 43 us; skew 500 ppm
Jun 18 23:23:49 dist-test-slave-r9ct krb5kdc[24803](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825029, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:49.313836 24816 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260618 23:23:49.314400 24816 webserver.cc:460] Webserver started at http://127.0.0.1:46557/ using document root <none> and password file <none>
I20260618 23:23:49.314631 24816 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:49.314700 24816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:49.314904 24816 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:49.315975 24816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "5a70977ad16c4de787d29ef83034a9bf"
format_stamp: "Formatted at 2026-06-18 23:23:49 on dist-test-slave-r9ct"
server_key: "6cd2bbdb96082709250b4fbaf86c1744"
server_key_iv: "f1c2df7393ac40f3628573b6df3d8d4e"
server_key_version: "encryptionkey@0"
I20260618 23:23:49.316354 24816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "5a70977ad16c4de787d29ef83034a9bf"
format_stamp: "Formatted at 2026-06-18 23:23:49 on dist-test-slave-r9ct"
server_key: "6cd2bbdb96082709250b4fbaf86c1744"
server_key_iv: "f1c2df7393ac40f3628573b6df3d8d4e"
server_key_version: "encryptionkey@0"
I20260618 23:23:49.317770 24816 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:23:49.318638 24831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:49.318991 24816 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:49.319271 24816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "5a70977ad16c4de787d29ef83034a9bf"
format_stamp: "Formatted at 2026-06-18 23:23:49 on dist-test-slave-r9ct"
server_key: "6cd2bbdb96082709250b4fbaf86c1744"
server_key_iv: "f1c2df7393ac40f3628573b6df3d8d4e"
server_key_version: "encryptionkey@0"
I20260618 23:23:49.319381 24816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:49.345789 24816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:49.348299 24816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:49.348482 24816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:49.352880 24816 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33475
I20260618 23:23:49.352926 24883 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33475 every 8 connection(s)
I20260618 23:23:49.353320 24816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:23:49.354575 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 24816
I20260618 23:23:49.354805 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:23:49.354887 24884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:49.355113 3942 external_mini_cluster.cc:1428] Setting key 46f891f1bc220d230f216590d2463d6e
I20260618 23:23:49.359174 24884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf: Bootstrap starting.
I20260618 23:23:49.359930 24884 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:49.360302 24884 log.cc:824] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:49.361341 24884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf: No bootstrap required, opened a new log
I20260618 23:23:49.363457 24884 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a70977ad16c4de787d29ef83034a9bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33475 } }
I20260618 23:23:49.363677 24884 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:49.363724 24884 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a70977ad16c4de787d29ef83034a9bf, State: Initialized, Role: FOLLOWER
I20260618 23:23:49.363859 24884 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a70977ad16c4de787d29ef83034a9bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33475 } }
I20260618 23:23:49.363951 24884 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:23:49.364004 24884 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:23:49.364053 24884 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf [term 0 FOLLOWER]: Advancing to term 1
Jun 18 23:23:49 dist-test-slave-r9ct krb5kdc[24803](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260618 23:23:49.364847 24884 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a70977ad16c4de787d29ef83034a9bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33475 } }
I20260618 23:23:49.364955 24884 leader_election.cc:302] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a70977ad16c4de787d29ef83034a9bf; no voters:
I20260618 23:23:49.365192 24884 leader_election.cc:288] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:23:49.365216 24889 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:49.365340 24889 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf [term 1 LEADER]: Becoming Leader. State: Replica: 5a70977ad16c4de787d29ef83034a9bf, State: Running, Role: LEADER
I20260618 23:23:49.365477 24889 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a70977ad16c4de787d29ef83034a9bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33475 } }
I20260618 23:23:49.365485 24884 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:23:49.365864 24890 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a70977ad16c4de787d29ef83034a9bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a70977ad16c4de787d29ef83034a9bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33475 } } }
I20260618 23:23:49.365999 24890 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:49.365860 24891 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a70977ad16c4de787d29ef83034a9bf. Latest consensus state: current_term: 1 leader_uuid: "5a70977ad16c4de787d29ef83034a9bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a70977ad16c4de787d29ef83034a9bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33475 } } }
I20260618 23:23:49.366448 24891 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:49.366624 24893 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:23:49.367179 24893 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:23:49.369850 24887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:49.355871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.173:53787 (local address 127.0.0.1:33475)
0618 23:23:49.356165 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:49.356175 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:49.356216 (+ 41us) server_negotiation.cc:407] Connection header received
0618 23:23:49.357071 (+ 855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:49.357078 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:49.357141 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:49.357302 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:49.357975 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:49.358984 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:49.359837 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:49.361045 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:49.361268 (+ 223us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:49.365183 (+ 3915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:49.365193 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:49.365193 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:49.365207 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:49.367466 (+ 2259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:49.367979 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:49.367991 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:49.367991 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:49.368094 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:49.368552 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:49.368554 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:49.368555 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:49.368985 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:49.369272 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:49.369530 (+ 258us) server_negotiation.cc:299] Negotiation successful
0618 23:23:49.369645 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":125,"threads_started":1}
I20260618 23:23:49.370378 24893 catalog_manager.cc:1347] Generated new cluster ID: aff19b5c4d6b4ac19edb666b878b2db4
I20260618 23:23:49.370436 24893 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:23:49.371093 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:23:49.379057 24893 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:23:49.379916 24893 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:23:49.382889 24887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:49.375074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.173:52557 (local address 127.0.0.1:33475)
0618 23:23:49.375110 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:49.375111 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:49.375292 (+ 181us) server_negotiation.cc:407] Connection header received
0618 23:23:49.375325 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:49.375326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:49.375336 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:49.375401 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:49.376078 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:49.377020 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:49.378021 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:49.378349 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:49.378422 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:49.380072 (+ 1650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:49.380073 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:49.380073 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:49.380080 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:49.381633 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:49.382066 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:49.382067 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:49.382068 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:49.382123 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:49.382351 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:49.382352 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:49.382352 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:49.382465 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:49.382557 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:49.382704 (+ 147us) server_negotiation.cc:299] Negotiation successful
0618 23:23:49.382800 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":8,"server-negotiator.queue_time_us":17}
I20260618 23:23:49.397559 24893 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5a70977ad16c4de787d29ef83034a9bf: Generated new TSK 0
I20260618 23:23:49.397781 24893 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:23:49.405475 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 24816
W20260618 23:23:49.409672 24801 connection.cc:535] client connection to 127.0.0.1:33475 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33475): Connection reset by peer (error 104)
2026-06-18T23:23:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1367 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:23:49 dist-test-slave-r9ct krb5kdc[24915](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:23:49 dist-test-slave-r9ct krb5kdc[24915](info): set up 2 sockets
Jun 18 23:23:49 dist-test-slave-r9ct krb5kdc[24915](info): commencing operation
krb5kdc: starting...
W20260618 23:23:50.483021 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:23:50 dist-test-slave-r9ct krb5kdc[24915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:23:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:23:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260618 23:23:50.617654 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45433
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45433
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:50.721262 24928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:50.721491 24928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:50.721518 24928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:50.722877 24928 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:23:50.722923 24928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:50.722939 24928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:50.722951 24928 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:23:50.722963 24928 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:23:50.724570 24928 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45433
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:50.724834 24928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:50.725116 24928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:50.730590 24936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:50.730599 24933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:50.730599 24934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:50.730922 24928 server_base.cc:1034] running on GCE node
I20260618 23:23:50.731223 24928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:50.731623 24928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:50.732788 24928 hybrid_clock.cc:648] HybridClock initialized: now 1781825030732781 us; error 43 us; skew 500 ppm
Jun 18 23:23:50 dist-test-slave-r9ct krb5kdc[24915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825030, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:50.735991 24928 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260618 23:23:50.736649 24928 webserver.cc:460] Webserver started at http://127.0.0.1:32837/ using document root <none> and password file <none>
I20260618 23:23:50.736928 24928 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:50.736989 24928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:50.737129 24928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:50.738231 24928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "dea15a0207464c5ba48a37e4eff51555"
format_stamp: "Formatted at 2026-06-18 23:23:50 on dist-test-slave-r9ct"
server_key: "97b72599f78239f5af4414e866585731"
server_key_iv: "65cce25f841693308bfd7e02cb3d1ed5"
server_key_version: "encryptionkey@0"
I20260618 23:23:50.738624 24928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "dea15a0207464c5ba48a37e4eff51555"
format_stamp: "Formatted at 2026-06-18 23:23:50 on dist-test-slave-r9ct"
server_key: "97b72599f78239f5af4414e866585731"
server_key_iv: "65cce25f841693308bfd7e02cb3d1ed5"
server_key_version: "encryptionkey@0"
I20260618 23:23:50.740190 24928 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:23:50.741261 24943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:50.741637 24928 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260618 23:23:50.741796 24928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "dea15a0207464c5ba48a37e4eff51555"
format_stamp: "Formatted at 2026-06-18 23:23:50 on dist-test-slave-r9ct"
server_key: "97b72599f78239f5af4414e866585731"
server_key_iv: "65cce25f841693308bfd7e02cb3d1ed5"
server_key_version: "encryptionkey@0"
I20260618 23:23:50.741914 24928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:50.755340 24928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:50.758420 24928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:50.758661 24928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:50.764408 24928 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45433
I20260618 23:23:50.764585 24995 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45433 every 8 connection(s)
I20260618 23:23:50.765071 24928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:23:50.766134 24996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:50.768517 24996 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555: Bootstrap starting.
I20260618 23:23:50.769074 24996 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:50.769342 24996 log.cc:824] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:50.770051 24996 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555: No bootstrap required, opened a new log
I20260618 23:23:50.771755 24996 raft_consensus.cc:348] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dea15a0207464c5ba48a37e4eff51555" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45433 } }
I20260618 23:23:50.771915 24996 raft_consensus.cc:374] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:50.771939 24996 raft_consensus.cc:729] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea15a0207464c5ba48a37e4eff51555, State: Initialized, Role: FOLLOWER
I20260618 23:23:50.772224 24996 consensus_queue.cc:260] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dea15a0207464c5ba48a37e4eff51555" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45433 } }
I20260618 23:23:50.772404 24996 raft_consensus.cc:388] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:23:50.772435 24996 raft_consensus.cc:482] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:23:50.772478 24996 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:50.773168 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 24928
I20260618 23:23:50.773430 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:23:50.773718 3942 external_mini_cluster.cc:1428] Setting key bd9d0fb3dda813df856e3ec24c727d1b
I20260618 23:23:50.773782 24996 raft_consensus.cc:504] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dea15a0207464c5ba48a37e4eff51555" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45433 } }
I20260618 23:23:50.773947 24996 leader_election.cc:302] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dea15a0207464c5ba48a37e4eff51555; no voters:
I20260618 23:23:50.774130 24996 leader_election.cc:288] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:23:50.774179 24999 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:50.774315 24999 raft_consensus.cc:686] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555 [term 1 LEADER]: Becoming Leader. State: Replica: dea15a0207464c5ba48a37e4eff51555, State: Running, Role: LEADER
I20260618 23:23:50.774410 24999 consensus_queue.cc:237] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dea15a0207464c5ba48a37e4eff51555" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45433 } }
I20260618 23:23:50.774433 24996 sys_catalog.cc:564] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:23:50.775331 25002 sys_catalog.cc:455] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dea15a0207464c5ba48a37e4eff51555. Latest consensus state: current_term: 1 leader_uuid: "dea15a0207464c5ba48a37e4eff51555" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dea15a0207464c5ba48a37e4eff51555" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45433 } } }
I20260618 23:23:50.775532 25002 sys_catalog.cc:458] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:50.775307 24999 sys_catalog.cc:455] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dea15a0207464c5ba48a37e4eff51555" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dea15a0207464c5ba48a37e4eff51555" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45433 } } }
I20260618 23:23:50.775786 24999 sys_catalog.cc:458] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:50.776029 25009 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:23:50.777160 25009 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:23:50.778995 25009 catalog_manager.cc:1347] Generated new cluster ID: 73a99d0bfbcc400382246e3a04fc0928
I20260618 23:23:50.779054 25009 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:23:50.780946 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:50.774257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.173:33613 (local address 127.0.0.1:45433)
0618 23:23:50.774512 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:50.774523 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:50.774567 (+ 44us) server_negotiation.cc:407] Connection header received
0618 23:23:50.774700 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:50.774740 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:50.774830 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:50.775036 (+ 206us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:50.775711 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:50.777509 (+ 1798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:50.778793 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:50.779343 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:50.779478 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:50.780240 (+ 762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:50.780244 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:50.780244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:50.780441 (+ 197us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:50.780471 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:50.780482 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:50.780574 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:50.780655 (+ 81us) server_negotiation.cc:299] Negotiation successful
0618 23:23:50.780786 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":69,"threads_started":1}
I20260618 23:23:50.781863 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:23:50.790457 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:50.783277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.173:43979 (local address 127.0.0.1:45433)
0618 23:23:50.783317 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:50.783319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:50.787022 (+ 3703us) server_negotiation.cc:407] Connection header received
0618 23:23:50.787110 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:50.787110 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:50.787122 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:50.787180 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:50.787332 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:50.787847 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:50.788667 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:50.788897 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:50.788981 (+ 84us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:50.790103 (+ 1122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:50.790105 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:50.790106 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:50.790119 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:50.790156 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:50.790162 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:50.790248 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:50.790315 (+ 67us) server_negotiation.cc:299] Negotiation successful
0618 23:23:50.790334 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260618 23:23:50.793466 25009 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:23:50.794116 25009 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:23:50.803485 25009 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dea15a0207464c5ba48a37e4eff51555: Generated new TSK 0
I20260618 23:23:50.803941 25009 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:23:50.808444 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 24928
W20260618 23:23:50.813958 24913 connection.cc:535] client connection to 127.0.0.1:45433 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45433): Connection reset by peer (error 104)
2026-06-18T23:23:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1404 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:23:50 dist-test-slave-r9ct krb5kdc[25027](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:23:50 dist-test-slave-r9ct krb5kdc[25027](info): set up 2 sockets
Jun 18 23:23:50 dist-test-slave-r9ct krb5kdc[25027](info): commencing operation
krb5kdc: starting...
W20260618 23:23:51.886950 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:23:51 dist-test-slave-r9ct krb5kdc[25027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825031, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:23:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:23:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260618 23:23:52.011073 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44909
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44909
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:52.091370 25040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:52.091569 25040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:52.091593 25040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:52.092710 25040 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:23:52.092752 25040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:52.092767 25040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:52.092780 25040 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:23:52.092792 25040 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:23:52.094260 25040 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44909
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44909
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25040
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:52.094513 25040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:52.094756 25040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:52.099824 25046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:52.099826 25045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:52.099915 25048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:52.100329 25040 server_base.cc:1034] running on GCE node
I20260618 23:23:52.100630 25040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:52.100953 25040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:52.102209 25040 hybrid_clock.cc:648] HybridClock initialized: now 1781825032102143 us; error 74 us; skew 500 ppm
Jun 18 23:23:52 dist-test-slave-r9ct krb5kdc[25027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825032, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:52.112632 25040 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260618 23:23:52.113322 25040 webserver.cc:460] Webserver started at http://127.0.0.1:40681/ using document root <none> and password file <none>
I20260618 23:23:52.113601 25040 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:52.113677 25040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:52.113870 25040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:52.115208 25040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "c3c2023296c84153a379c2e4adc0ece1"
format_stamp: "Formatted at 2026-06-18 23:23:52 on dist-test-slave-r9ct"
server_key: "e09a173d6f51682b695bfdb4227ecf74"
server_key_iv: "42adbbfe5191acfd32ecc5506eb851f0"
server_key_version: "encryptionkey@0"
I20260618 23:23:52.115604 25040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "c3c2023296c84153a379c2e4adc0ece1"
format_stamp: "Formatted at 2026-06-18 23:23:52 on dist-test-slave-r9ct"
server_key: "e09a173d6f51682b695bfdb4227ecf74"
server_key_iv: "42adbbfe5191acfd32ecc5506eb851f0"
server_key_version: "encryptionkey@0"
I20260618 23:23:52.117175 25040 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260618 23:23:52.118319 25055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:52.118546 25040 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:52.118675 25040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "c3c2023296c84153a379c2e4adc0ece1"
format_stamp: "Formatted at 2026-06-18 23:23:52 on dist-test-slave-r9ct"
server_key: "e09a173d6f51682b695bfdb4227ecf74"
server_key_iv: "42adbbfe5191acfd32ecc5506eb851f0"
server_key_version: "encryptionkey@0"
I20260618 23:23:52.118839 25040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:52.122599 25040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:52.124955 25040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:52.125115 25040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:52.129233 25040 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44909
I20260618 23:23:52.129274 25107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44909 every 8 connection(s)
I20260618 23:23:52.129619 25040 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:23:52.130652 25108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:52.133162 25108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1: Bootstrap starting.
I20260618 23:23:52.134138 25108 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:52.134668 25108 log.cc:824] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:52.135725 25108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1: No bootstrap required, opened a new log
I20260618 23:23:52.136221 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 25040
I20260618 23:23:52.136353 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:23:52.136570 3942 external_mini_cluster.cc:1428] Setting key cab03d17457b42014371d79e0854e55e
I20260618 23:23:52.139029 25108 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3c2023296c84153a379c2e4adc0ece1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44909 } }
I20260618 23:23:52.139206 25108 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:52.139252 25108 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3c2023296c84153a379c2e4adc0ece1, State: Initialized, Role: FOLLOWER
I20260618 23:23:52.139410 25108 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3c2023296c84153a379c2e4adc0ece1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44909 } }
I20260618 23:23:52.139504 25108 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:23:52.139540 25108 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:23:52.139590 25108 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:52.140511 25112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:52.137240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.173:33477 (local address 127.0.0.1:44909)
0618 23:23:52.137494 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:52.137503 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:52.137535 (+ 32us) server_negotiation.cc:407] Connection header received
0618 23:23:52.138988 (+ 1453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:52.138996 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:52.139031 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:52.139184 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:52.139929 (+ 745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:52.139933 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:52.139934 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:52.139938 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:52.140014 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:52.140034 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:52.140098 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:52.140227 (+ 129us) server_negotiation.cc:299] Negotiation successful
0618 23:23:52.140281 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":99,"threads_started":1}
I20260618 23:23:52.140906 25108 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3c2023296c84153a379c2e4adc0ece1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44909 } }
I20260618 23:23:52.141003 25108 leader_election.cc:302] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3c2023296c84153a379c2e4adc0ece1; no voters:
I20260618 23:23:52.141286 25108 leader_election.cc:288] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:23:52.141484 25114 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:52.141615 25108 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:23:52.141778 25114 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1 [term 1 LEADER]: Becoming Leader. State: Replica: c3c2023296c84153a379c2e4adc0ece1, State: Running, Role: LEADER
I20260618 23:23:52.141891 25114 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3c2023296c84153a379c2e4adc0ece1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44909 } }
I20260618 23:23:52.142403 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:23:52.142395 25114 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3c2023296c84153a379c2e4adc0ece1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3c2023296c84153a379c2e4adc0ece1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44909 } } }
I20260618 23:23:52.142477 25114 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:52.142603 25114 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3c2023296c84153a379c2e4adc0ece1. Latest consensus state: current_term: 1 leader_uuid: "c3c2023296c84153a379c2e4adc0ece1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3c2023296c84153a379c2e4adc0ece1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44909 } } }
I20260618 23:23:52.142652 25114 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:52.142786 25122 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:23:52.143311 25122 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:23:52.145196 25122 catalog_manager.cc:1347] Generated new cluster ID: 6d6e9609414347c1a68505795609ceb6
I20260618 23:23:52.145255 25122 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:23:52.145557 25112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:52.144066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.173:54959 (local address 127.0.0.1:44909)
0618 23:23:52.144103 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:52.144105 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:52.144247 (+ 142us) server_negotiation.cc:407] Connection header received
0618 23:23:52.144377 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:52.144378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:52.144384 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:52.144436 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:52.145225 (+ 789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:52.145227 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:52.145228 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:52.145233 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:52.145257 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:52.145263 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:52.145325 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:52.145439 (+ 114us) server_negotiation.cc:299] Negotiation successful
0618 23:23:52.145457 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260618 23:23:52.169574 25122 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:23:52.169777 25122 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:23:52.176394 25122 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3c2023296c84153a379c2e4adc0ece1: Generated new TSK 0
I20260618 23:23:52.176575 25122 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:23:52.179553 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 25040
2026-06-18T23:23:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1370 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:23:52 dist-test-slave-r9ct krb5kdc[25139](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:23:52 dist-test-slave-r9ct krb5kdc[25139](info): set up 2 sockets
Jun 18 23:23:52 dist-test-slave-r9ct krb5kdc[25139](info): commencing operation
krb5kdc: starting...
W20260618 23:23:53.238922 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.041s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:23:53 dist-test-slave-r9ct krb5kdc[25139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:23:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:23:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260618 23:23:53.362041 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44315
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44315
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:53.442476 25152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:53.442731 25152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:53.442796 25152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:53.443962 25152 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:23:53.444029 25152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:53.444053 25152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:53.444080 25152 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:23:53.444111 25152 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:23:53.445824 25152 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44315
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:53.446126 25152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:53.446401 25152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:53.451265 25157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:53.451229 25158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:53.451331 25152 server_base.cc:1034] running on GCE node
W20260618 23:23:53.451471 25160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:53.451743 25152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:53.452029 25152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:53.453213 25152 hybrid_clock.cc:648] HybridClock initialized: now 1781825033453177 us; error 58 us; skew 500 ppm
Jun 18 23:23:53 dist-test-slave-r9ct krb5kdc[25139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825033, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:53.455821 25152 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260618 23:23:53.456295 25152 webserver.cc:460] Webserver started at http://127.0.0.1:36239/ using document root <none> and password file <none>
I20260618 23:23:53.456534 25152 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:53.456604 25152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:53.456754 25152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:53.457825 25152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "b64754e60a9a4f58ad085c6c861aef91"
format_stamp: "Formatted at 2026-06-18 23:23:53 on dist-test-slave-r9ct"
server_key: "2fd6440cd383a95e7b544a7f0389af79"
server_key_iv: "eda307e5ab975e461e07daa801ccae29"
server_key_version: "encryptionkey@0"
I20260618 23:23:53.458171 25152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "b64754e60a9a4f58ad085c6c861aef91"
format_stamp: "Formatted at 2026-06-18 23:23:53 on dist-test-slave-r9ct"
server_key: "2fd6440cd383a95e7b544a7f0389af79"
server_key_iv: "eda307e5ab975e461e07daa801ccae29"
server_key_version: "encryptionkey@0"
I20260618 23:23:53.459561 25152 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:23:53.460353 25167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:53.460592 25152 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:53.460717 25152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "b64754e60a9a4f58ad085c6c861aef91"
format_stamp: "Formatted at 2026-06-18 23:23:53 on dist-test-slave-r9ct"
server_key: "2fd6440cd383a95e7b544a7f0389af79"
server_key_iv: "eda307e5ab975e461e07daa801ccae29"
server_key_version: "encryptionkey@0"
I20260618 23:23:53.460794 25152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:53.484709 25152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:53.486958 25152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:53.487130 25152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:53.492271 25152 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44315
I20260618 23:23:53.492398 25219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44315 every 8 connection(s)
I20260618 23:23:53.492837 25152 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:23:53.493827 25220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:53.496013 25220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91: Bootstrap starting.
I20260618 23:23:53.496541 25220 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:53.496781 25220 log.cc:824] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:53.497711 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 25152
I20260618 23:23:53.497855 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:23:53.497834 25220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91: No bootstrap required, opened a new log
I20260618 23:23:53.498098 3942 external_mini_cluster.cc:1428] Setting key 05fc6e26f9a98374517e605529a38553
I20260618 23:23:53.501672 25220 raft_consensus.cc:348] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b64754e60a9a4f58ad085c6c861aef91" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44315 } }
I20260618 23:23:53.501863 25220 raft_consensus.cc:374] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:53.501914 25220 raft_consensus.cc:729] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b64754e60a9a4f58ad085c6c861aef91, State: Initialized, Role: FOLLOWER
I20260618 23:23:53.502099 25220 consensus_queue.cc:260] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b64754e60a9a4f58ad085c6c861aef91" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44315 } }
I20260618 23:23:53.502218 25220 raft_consensus.cc:388] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:23:53.502256 25220 raft_consensus.cc:482] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:23:53.502300 25220 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:53.503170 25220 raft_consensus.cc:504] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b64754e60a9a4f58ad085c6c861aef91" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44315 } }
I20260618 23:23:53.503367 25220 leader_election.cc:302] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b64754e60a9a4f58ad085c6c861aef91; no voters:
I20260618 23:23:53.503553 25220 leader_election.cc:288] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:23:53.503625 25225 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:53.503777 25225 raft_consensus.cc:686] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91 [term 1 LEADER]: Becoming Leader. State: Replica: b64754e60a9a4f58ad085c6c861aef91, State: Running, Role: LEADER
I20260618 23:23:53.503855 25220 sys_catalog.cc:564] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:23:53.503867 25225 consensus_queue.cc:237] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b64754e60a9a4f58ad085c6c861aef91" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44315 } }
I20260618 23:23:53.504230 25225 sys_catalog.cc:455] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b64754e60a9a4f58ad085c6c861aef91. Latest consensus state: current_term: 1 leader_uuid: "b64754e60a9a4f58ad085c6c861aef91" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b64754e60a9a4f58ad085c6c861aef91" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44315 } } }
I20260618 23:23:53.504305 25225 sys_catalog.cc:458] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:53.504588 25226 sys_catalog.cc:455] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b64754e60a9a4f58ad085c6c861aef91" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b64754e60a9a4f58ad085c6c861aef91" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44315 } } }
I20260618 23:23:53.504693 25226 sys_catalog.cc:458] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:53.505357 25229 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:23:53.505930 25229 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Jun 18 23:23:53 dist-test-slave-r9ct krb5kdc[25139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260618 23:23:53.507750 25229 catalog_manager.cc:1347] Generated new cluster ID: f90e9b4dc287451186a4078a3cc45071
I20260618 23:23:53.507803 25229 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:23:53.511535 25224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:53.498813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.173:48315 (local address 127.0.0.1:44315)
0618 23:23:53.499005 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:53.499019 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:53.499047 (+ 28us) server_negotiation.cc:407] Connection header received
0618 23:23:53.499736 (+ 689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:53.499744 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:53.499799 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:53.499924 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:53.500928 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:53.502044 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:53.503429 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:53.504500 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:53.504669 (+ 169us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:53.507687 (+ 3018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:53.507690 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:53.507690 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:53.507701 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:53.509707 (+ 2006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:53.510207 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:53.510210 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:53.510210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:53.510315 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:53.510568 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:53.510569 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:53.510569 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:53.510908 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:53.511063 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:53.511216 (+ 153us) server_negotiation.cc:299] Negotiation successful
0618 23:23:53.511316 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":94,"threads_started":1}
I20260618 23:23:53.512509 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:23:53.521494 25224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:53.514025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.173:43723 (local address 127.0.0.1:44315)
0618 23:23:53.514179 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:53.514182 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:53.514197 (+ 15us) server_negotiation.cc:407] Connection header received
0618 23:23:53.514243 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:53.514245 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:53.514258 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:53.514366 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:53.515035 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:53.515811 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:53.516884 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:53.517220 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:53.517303 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:53.518646 (+ 1343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:53.518648 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:53.518648 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:53.518654 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:53.520211 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:53.520634 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:53.520635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:53.520636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:53.520689 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:53.520909 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:53.520910 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:53.520910 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:53.521026 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:53.521115 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:53.521315 (+ 200us) server_negotiation.cc:299] Negotiation successful
0618 23:23:53.521375 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260618 23:23:53.533860 25229 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:23:53.534389 25229 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:23:53.540331 25229 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b64754e60a9a4f58ad085c6c861aef91: Generated new TSK 0
I20260618 23:23:53.540501 25229 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:23:53.548049 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 25152
W20260618 23:23:53.552215 25137 connection.cc:535] client connection to 127.0.0.1:44315 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44315): Connection reset by peer (error 104)
2026-06-18T23:23:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1367 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:23:53 dist-test-slave-r9ct krb5kdc[25251](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:23:53 dist-test-slave-r9ct krb5kdc[25251](info): set up 2 sockets
Jun 18 23:23:53 dist-test-slave-r9ct krb5kdc[25251](info): commencing operation
krb5kdc: starting...
W20260618 23:23:54.598949 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.033s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:23:54 dist-test-slave-r9ct krb5kdc[25251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825034, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:23:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:23:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260618 23:23:54.717753 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38517
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38517
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:54.799604 25264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:54.799808 25264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:54.799830 25264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:54.800953 25264 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:23:54.800995 25264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:54.801010 25264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:54.801023 25264 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:23:54.801034 25264 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:23:54.802493 25264 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38517
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38517
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25264
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:54.802718 25264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:54.802965 25264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:54.807726 25272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:54.807726 25269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:54.807765 25270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:54.807997 25264 server_base.cc:1034] running on GCE node
I20260618 23:23:54.808220 25264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:54.808458 25264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:54.809621 25264 hybrid_clock.cc:648] HybridClock initialized: now 1781825034809605 us; error 38 us; skew 500 ppm
Jun 18 23:23:54 dist-test-slave-r9ct krb5kdc[25251](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825034, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:54.812168 25264 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260618 23:23:54.812700 25264 webserver.cc:460] Webserver started at http://127.0.0.1:34323/ using document root <none> and password file <none>
I20260618 23:23:54.812951 25264 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:54.813002 25264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:54.813136 25264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:54.814247 25264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "484cd931cda84eda9910ea99b966838c"
format_stamp: "Formatted at 2026-06-18 23:23:54 on dist-test-slave-r9ct"
server_key: "2a6be85de9826874aae1bdf246f9d1c8"
server_key_iv: "758d1f46ae662eb951fa37592f71cdc2"
server_key_version: "encryptionkey@0"
I20260618 23:23:54.814617 25264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "484cd931cda84eda9910ea99b966838c"
format_stamp: "Formatted at 2026-06-18 23:23:54 on dist-test-slave-r9ct"
server_key: "2a6be85de9826874aae1bdf246f9d1c8"
server_key_iv: "758d1f46ae662eb951fa37592f71cdc2"
server_key_version: "encryptionkey@0"
I20260618 23:23:54.816045 25264 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:23:54.817076 25279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:54.817381 25264 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:23:54.817485 25264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "484cd931cda84eda9910ea99b966838c"
format_stamp: "Formatted at 2026-06-18 23:23:54 on dist-test-slave-r9ct"
server_key: "2a6be85de9826874aae1bdf246f9d1c8"
server_key_iv: "758d1f46ae662eb951fa37592f71cdc2"
server_key_version: "encryptionkey@0"
I20260618 23:23:54.817561 25264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:54.831915 25264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:54.834569 25264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:54.834795 25264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:54.839793 25264 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38517
I20260618 23:23:54.839834 25331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38517 every 8 connection(s)
I20260618 23:23:54.840207 25264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:23:54.841167 25332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:54.842770 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 25264
I20260618 23:23:54.842900 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:23:54.843087 3942 external_mini_cluster.cc:1428] Setting key 0041c277c3a8425e80cb97d86cd3fbe2
I20260618 23:23:54.843852 25332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c: Bootstrap starting.
I20260618 23:23:54.844419 25332 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:54.844769 25332 log.cc:824] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:54.845413 25332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c: No bootstrap required, opened a new log
I20260618 23:23:54.848012 25332 raft_consensus.cc:348] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "484cd931cda84eda9910ea99b966838c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38517 } }
I20260618 23:23:54.848189 25332 raft_consensus.cc:374] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:54.848237 25332 raft_consensus.cc:729] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 484cd931cda84eda9910ea99b966838c, State: Initialized, Role: FOLLOWER
I20260618 23:23:54.848367 25332 consensus_queue.cc:260] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "484cd931cda84eda9910ea99b966838c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38517 } }
I20260618 23:23:54.848440 25332 raft_consensus.cc:388] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:23:54.848462 25332 raft_consensus.cc:482] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:23:54.848527 25332 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:54.848985 25335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:54.843668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.173:47207 (local address 127.0.0.1:38517)
0618 23:23:54.843837 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:54.843844 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:54.843869 (+ 25us) server_negotiation.cc:407] Connection header received
0618 23:23:54.844319 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:54.844325 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:54.844372 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:54.844521 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:54.844734 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:54.845690 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:54.846956 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:54.847371 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:54.847469 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:54.848219 (+ 750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:54.848223 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:54.848223 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:54.848466 (+ 243us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:54.848505 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:54.848521 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:54.848597 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:54.848731 (+ 134us) server_negotiation.cc:299] Negotiation successful
0618 23:23:54.848774 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":85,"threads_started":1}
I20260618 23:23:54.849169 25332 raft_consensus.cc:504] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "484cd931cda84eda9910ea99b966838c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38517 } }
I20260618 23:23:54.849318 25332 leader_election.cc:302] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 484cd931cda84eda9910ea99b966838c; no voters:
I20260618 23:23:54.849488 25332 leader_election.cc:288] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:23:54.849509 25337 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:54.849620 25337 raft_consensus.cc:686] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c [term 1 LEADER]: Becoming Leader. State: Replica: 484cd931cda84eda9910ea99b966838c, State: Running, Role: LEADER
I20260618 23:23:54.849706 25337 consensus_queue.cc:237] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "484cd931cda84eda9910ea99b966838c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38517 } }
I20260618 23:23:54.849733 25332 sys_catalog.cc:564] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:23:54.849871 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:23:54.850039 25339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "484cd931cda84eda9910ea99b966838c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "484cd931cda84eda9910ea99b966838c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38517 } } }
I20260618 23:23:54.850127 25339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:54.850296 25338 sys_catalog.cc:455] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 484cd931cda84eda9910ea99b966838c. Latest consensus state: current_term: 1 leader_uuid: "484cd931cda84eda9910ea99b966838c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "484cd931cda84eda9910ea99b966838c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38517 } } }
I20260618 23:23:54.850350 25342 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:23:54.851012 25342 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:23:54.850360 25338 sys_catalog.cc:458] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:54.852881 25342 catalog_manager.cc:1347] Generated new cluster ID: 4477bdd0c79a4b22ab1e146f46b52a69
I20260618 23:23:54.852931 25342 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:23:54.855877 25335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:54.852228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.173:53419 (local address 127.0.0.1:38517)
0618 23:23:54.852263 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:54.852265 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:54.852451 (+ 186us) server_negotiation.cc:407] Connection header received
0618 23:23:54.852510 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:54.852511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:54.852521 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:54.852571 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:54.852754 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:54.853492 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:54.854482 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:54.854846 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:54.854922 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:54.855627 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:54.855629 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:54.855629 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:54.855633 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:54.855648 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:54.855652 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:54.855722 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:54.855796 (+ 74us) server_negotiation.cc:299] Negotiation successful
0618 23:23:54.855806 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260618 23:23:54.870695 25342 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:23:54.871455 25342 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:23:54.885254 25342 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 484cd931cda84eda9910ea99b966838c: Generated new TSK 0
I20260618 23:23:54.885445 25342 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:23:54.889055 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 25264
W20260618 23:23:54.892577 25249 connection.cc:535] client connection to 127.0.0.1:38517 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38517): Connection reset by peer (error 104)
2026-06-18T23:23:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1340 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:23:54 dist-test-slave-r9ct krb5kdc[25363](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:23:54 dist-test-slave-r9ct krb5kdc[25363](info): set up 2 sockets
Jun 18 23:23:54 dist-test-slave-r9ct krb5kdc[25363](info): commencing operation
krb5kdc: starting...
W20260618 23:23:55.934922 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.028s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:23:56 dist-test-slave-r9ct krb5kdc[25363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:23:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:23:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260618 23:23:56.058583 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35145
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35145
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:56.142318 25376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:56.142566 25376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:56.142611 25376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:56.144060 25376 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:23:56.144133 25376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:56.144157 25376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:56.144186 25376 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:23:56.144223 25376 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:23:56.145743 25376 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35145
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:56.146018 25376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:56.146293 25376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:56.151093 25384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:56.151083 25382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:56.151083 25381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:56.151409 25376 server_base.cc:1034] running on GCE node
I20260618 23:23:56.151705 25376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:56.152009 25376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:56.153183 25376 hybrid_clock.cc:648] HybridClock initialized: now 1781825036153144 us; error 67 us; skew 500 ppm
Jun 18 23:23:56 dist-test-slave-r9ct krb5kdc[25363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825036, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:56.156312 25376 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260618 23:23:56.156806 25376 webserver.cc:460] Webserver started at http://127.0.0.1:43597/ using document root <none> and password file <none>
I20260618 23:23:56.157027 25376 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:56.157091 25376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:56.157256 25376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:56.158308 25376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "652d3d595a324bf7867fa3afdf709fe8"
format_stamp: "Formatted at 2026-06-18 23:23:56 on dist-test-slave-r9ct"
server_key: "11d702b8f19ac275b39fd18c228b149f"
server_key_iv: "555b9d1d6977047fdbbd67ec15004c37"
server_key_version: "encryptionkey@0"
I20260618 23:23:56.158656 25376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "652d3d595a324bf7867fa3afdf709fe8"
format_stamp: "Formatted at 2026-06-18 23:23:56 on dist-test-slave-r9ct"
server_key: "11d702b8f19ac275b39fd18c228b149f"
server_key_iv: "555b9d1d6977047fdbbd67ec15004c37"
server_key_version: "encryptionkey@0"
I20260618 23:23:56.160085 25376 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:56.161031 25391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:56.161329 25376 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:23:56.161446 25376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "652d3d595a324bf7867fa3afdf709fe8"
format_stamp: "Formatted at 2026-06-18 23:23:56 on dist-test-slave-r9ct"
server_key: "11d702b8f19ac275b39fd18c228b149f"
server_key_iv: "555b9d1d6977047fdbbd67ec15004c37"
server_key_version: "encryptionkey@0"
I20260618 23:23:56.161520 25376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:56.164810 25376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:56.167026 25376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:56.167177 25376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:56.171600 25376 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35145
I20260618 23:23:56.171635 25443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35145 every 8 connection(s)
I20260618 23:23:56.171984 25376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:23:56.173079 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 25376
I20260618 23:23:56.173105 25444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:56.173213 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:23:56.173398 3942 external_mini_cluster.cc:1428] Setting key 3bfd2892dbb0e85f99b5fba608a13eb5
I20260618 23:23:56.176111 25447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:56.173931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.173:51853 (local address 127.0.0.1:35145)
0618 23:23:56.174124 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:56.174133 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:56.174164 (+ 31us) server_negotiation.cc:407] Connection header received
0618 23:23:56.174676 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:56.174684 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:56.174717 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:56.174891 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:56.175530 (+ 639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:56.175533 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:56.175534 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:56.175538 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:56.175579 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:56.175593 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:56.175673 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:56.175885 (+ 212us) server_negotiation.cc:299] Negotiation successful
0618 23:23:56.175930 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":89,"threads_started":1}
I20260618 23:23:56.176604 25444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8: Bootstrap starting.
I20260618 23:23:56.177285 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:23:56.177351 25444 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:56.177619 25444 log.cc:824] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:56.178385 25444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8: No bootstrap required, opened a new log
I20260618 23:23:56.180092 25447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:56.178871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.173:57927 (local address 127.0.0.1:35145)
0618 23:23:56.178928 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:56.178930 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:56.179134 (+ 204us) server_negotiation.cc:407] Connection header received
0618 23:23:56.179153 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:56.179153 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:56.179158 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:56.179200 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:56.179726 (+ 526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:56.179727 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:56.179727 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:56.179731 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:56.179744 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:56.179748 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:56.179796 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:56.179852 (+ 56us) server_negotiation.cc:299] Negotiation successful
0618 23:23:56.179862 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260618 23:23:56.180922 25444 raft_consensus.cc:348] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "652d3d595a324bf7867fa3afdf709fe8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35145 } }
I20260618 23:23:56.181056 25444 raft_consensus.cc:374] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:56.181077 25444 raft_consensus.cc:729] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 652d3d595a324bf7867fa3afdf709fe8, State: Initialized, Role: FOLLOWER
I20260618 23:23:56.181181 25444 consensus_queue.cc:260] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "652d3d595a324bf7867fa3afdf709fe8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35145 } }
I20260618 23:23:56.181267 25444 raft_consensus.cc:388] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:23:56.181289 25444 raft_consensus.cc:482] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:23:56.181316 25444 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:56.181802 25444 raft_consensus.cc:504] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "652d3d595a324bf7867fa3afdf709fe8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35145 } }
I20260618 23:23:56.181880 25444 leader_election.cc:302] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 652d3d595a324bf7867fa3afdf709fe8; no voters:
I20260618 23:23:56.181995 25444 leader_election.cc:288] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:23:56.182050 25454 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:56.182233 25454 raft_consensus.cc:686] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8 [term 1 LEADER]: Becoming Leader. State: Replica: 652d3d595a324bf7867fa3afdf709fe8, State: Running, Role: LEADER
I20260618 23:23:56.182279 25444 sys_catalog.cc:564] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:23:56.182327 25454 consensus_queue.cc:237] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "652d3d595a324bf7867fa3afdf709fe8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35145 } }
I20260618 23:23:56.182727 25455 sys_catalog.cc:455] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "652d3d595a324bf7867fa3afdf709fe8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "652d3d595a324bf7867fa3afdf709fe8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35145 } } }
I20260618 23:23:56.182767 25456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 652d3d595a324bf7867fa3afdf709fe8. Latest consensus state: current_term: 1 leader_uuid: "652d3d595a324bf7867fa3afdf709fe8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "652d3d595a324bf7867fa3afdf709fe8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35145 } } }
I20260618 23:23:56.182904 25455 sys_catalog.cc:458] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:56.182920 25456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:56.183254 25463 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:23:56.183697 25463 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:23:56.185554 25463 catalog_manager.cc:1347] Generated new cluster ID: 2f640f9862254df0bc29810579ba4163
I20260618 23:23:56.185614 25463 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:23:56.197320 25463 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:23:56.197499 25463 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:23:56.207054 25463 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 652d3d595a324bf7867fa3afdf709fe8: Generated new TSK 0
I20260618 23:23:56.207243 25463 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:23:56.215004 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 25376
2026-06-18T23:23:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1326 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:23:56 dist-test-slave-r9ct krb5kdc[25475](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:23:56 dist-test-slave-r9ct krb5kdc[25475](info): set up 2 sockets
Jun 18 23:23:56 dist-test-slave-r9ct krb5kdc[25475](info): commencing operation
krb5kdc: starting...
W20260618 23:23:57.271395 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:23:57 dist-test-slave-r9ct krb5kdc[25475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:23:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:23:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:23:57.398442 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:40601
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:41227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:40601
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:57.482257 25488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:57.482460 25488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:57.482483 25488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:57.483821 25488 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:23:57.483872 25488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:57.483887 25488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:57.483899 25488 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:23:57.483911 25488 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:23:57.485442 25488 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:41227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:40601
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:40601
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25488
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:57.485687 25488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:57.485932 25488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260618 23:23:57.490967 25488 server_base.cc:1034] running on GCE node
W20260618 23:23:57.490942 25494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:57.490942 25493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:57.490931 25496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:57.491371 25488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:57.491607 25488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:57.492769 25488 hybrid_clock.cc:648] HybridClock initialized: now 1781825037492691 us; error 94 us; skew 500 ppm
Jun 18 23:23:57 dist-test-slave-r9ct krb5kdc[25475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825037, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:57.500794 25488 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:23:57.501291 25488 webserver.cc:460] Webserver started at http://127.3.217.190:42877/ using document root <none> and password file <none>
I20260618 23:23:57.501534 25488 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:57.501602 25488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:57.501757 25488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:57.502889 25488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "11d5b8cd7149479a92c70926c665089a"
format_stamp: "Formatted at 2026-06-18 23:23:57 on dist-test-slave-r9ct"
server_key: "c77a04b3ed0c87e1752bd8341cebd1d5"
server_key_iv: "c5918bb0b2bf8b614259acd7a6215298"
server_key_version: "encryptionkey@0"
I20260618 23:23:57.503239 25488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "11d5b8cd7149479a92c70926c665089a"
format_stamp: "Formatted at 2026-06-18 23:23:57 on dist-test-slave-r9ct"
server_key: "c77a04b3ed0c87e1752bd8341cebd1d5"
server_key_iv: "c5918bb0b2bf8b614259acd7a6215298"
server_key_version: "encryptionkey@0"
I20260618 23:23:57.504617 25488 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260618 23:23:57.505474 25503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:57.505687 25488 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:23:57.505841 25488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "11d5b8cd7149479a92c70926c665089a"
format_stamp: "Formatted at 2026-06-18 23:23:57 on dist-test-slave-r9ct"
server_key: "c77a04b3ed0c87e1752bd8341cebd1d5"
server_key_iv: "c5918bb0b2bf8b614259acd7a6215298"
server_key_version: "encryptionkey@0"
I20260618 23:23:57.505921 25488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:57.516853 25488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:57.519373 25488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:57.519548 25488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:57.523695 25488 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:40601
I20260618 23:23:57.523748 25555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:40601 every 8 connection(s)
I20260618 23:23:57.524080 25488 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:23:57.524920 25556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:57.527359 25556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a: Bootstrap starting.
I20260618 23:23:57.527930 25556 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:57.528229 25556 log.cc:824] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:57.529013 25556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a: No bootstrap required, opened a new log
I20260618 23:23:57.530771 25556 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11d5b8cd7149479a92c70926c665089a" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 40601 } }
I20260618 23:23:57.530917 25556 raft_consensus.cc:374] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:57.530939 25556 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d5b8cd7149479a92c70926c665089a, State: Initialized, Role: FOLLOWER
I20260618 23:23:57.531040 25556 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11d5b8cd7149479a92c70926c665089a" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 40601 } }
I20260618 23:23:57.531088 25556 raft_consensus.cc:388] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:23:57.531129 25556 raft_consensus.cc:482] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:23:57.531155 25556 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:57.531946 25556 raft_consensus.cc:504] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11d5b8cd7149479a92c70926c665089a" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 40601 } }
I20260618 23:23:57.532027 25556 leader_election.cc:302] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11d5b8cd7149479a92c70926c665089a; no voters:
I20260618 23:23:57.532138 25556 leader_election.cc:288] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:23:57.532194 25559 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:57.532399 25559 raft_consensus.cc:686] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a [term 1 LEADER]: Becoming Leader. State: Replica: 11d5b8cd7149479a92c70926c665089a, State: Running, Role: LEADER
I20260618 23:23:57.532428 25556 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:23:57.532541 25559 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11d5b8cd7149479a92c70926c665089a" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 40601 } }
I20260618 23:23:57.532946 25560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11d5b8cd7149479a92c70926c665089a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11d5b8cd7149479a92c70926c665089a" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 40601 } } }
I20260618 23:23:57.532976 25561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11d5b8cd7149479a92c70926c665089a. Latest consensus state: current_term: 1 leader_uuid: "11d5b8cd7149479a92c70926c665089a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11d5b8cd7149479a92c70926c665089a" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 40601 } } }
I20260618 23:23:57.533104 25561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:57.533463 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 25488
I20260618 23:23:57.533593 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:23:57.533881 3942 external_mini_cluster.cc:1428] Setting key ed502e99c726adcb5f01f21e36c1fbff
I20260618 23:23:57.534054 25560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a [sys.catalog]: This master's current role is: LEADER
W20260618 23:23:57.534476 25575 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260618 23:23:57.534657 25575 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260618 23:23:57.534761 25568 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:23:57.534921 25568 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:23:57.536343 25568 catalog_manager.cc:1347] Generated new cluster ID: f66a8597a19f4ffd9a7717f112a7c068
I20260618 23:23:57.536391 25568 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 18 23:23:57 dist-test-slave-r9ct krb5kdc[25475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:23:57.551030 25568 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:23:57.551707 25568 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:23:57.552255 25578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:57.534533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57713 (local address 127.3.217.190:40601)
0618 23:23:57.542906 (+ 8373us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:57.542914 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:57.542947 (+ 33us) server_negotiation.cc:407] Connection header received
0618 23:23:57.543050 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:57.543056 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:57.543100 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:57.543261 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:57.543996 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:57.544940 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:57.545692 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:57.546171 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:57.546299 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:57.548720 (+ 2421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:57.548726 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:57.548726 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:57.548743 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:57.550389 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:57.550979 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:57.550982 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:57.550983 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:57.551096 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:57.551365 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:57.551366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:57.551366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:57.551590 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:57.551781 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:57.551890 (+ 109us) server_negotiation.cc:299] Negotiation successful
0618 23:23:57.552084 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8310,"thread_start_us":83,"threads_started":1}
I20260618 23:23:57.553344 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:23:57.558845 25568 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 11d5b8cd7149479a92c70926c665089a: Generated new TSK 0
I20260618 23:23:57.559021 25568 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:23:57.566370 25578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:57.554951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60657 (local address 127.3.217.190:40601)
0618 23:23:57.554991 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:57.554993 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:57.558884 (+ 3891us) server_negotiation.cc:407] Connection header received
0618 23:23:57.558981 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:57.558982 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:57.558992 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:57.559022 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:57.559827 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:57.560429 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:57.561660 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:57.561896 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:57.561969 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:57.563396 (+ 1427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:57.563397 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:57.563398 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:23:57.563404 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:57.565088 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:57.565518 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:57.565519 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:57.565519 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:57.565572 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:23:57.565839 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:23:57.565840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:23:57.565841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:23:57.565958 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:57.566047 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:57.566215 (+ 168us) server_negotiation.cc:299] Negotiation successful
0618 23:23:57.566266 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260618 23:23:57.568282 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 25488
W20260618 23:23:57.572327 25473 connection.cc:535] client connection to 127.3.217.190:40601 recv error: Network error: failed to read from TLS socket (remote: 127.3.217.190:40601): Connection reset by peer (error 104)
2026-06-18T23:23:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1352 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:23:57 dist-test-slave-r9ct krb5kdc[25587](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:23:57 dist-test-slave-r9ct krb5kdc[25587](info): set up 2 sockets
Jun 18 23:23:57 dist-test-slave-r9ct krb5kdc[25587](info): commencing operation
krb5kdc: starting...
W20260618 23:23:58.606921 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.021s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:23:58 dist-test-slave-r9ct krb5kdc[25587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825038, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:23:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:23:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:23:58.735428 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:43641
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:45771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:43641
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:23:58.817777 25600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:23:58.818038 25600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:23:58.818078 25600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:23:58.819269 25600 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:23:58.819341 25600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:23:58.819366 25600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:23:58.819394 25600 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:23:58.819422 25600 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:23:58.822175 25600 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:45771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:43641
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:43641
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25600
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:23:58.822517 25600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:23:58.822790 25600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:23:58.829420 25608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:58.829417 25605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:23:58.829782 25606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:23:58.829797 25600 server_base.cc:1034] running on GCE node
I20260618 23:23:58.830066 25600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:23:58.830418 25600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:23:58.831607 25600 hybrid_clock.cc:648] HybridClock initialized: now 1781825038831566 us; error 59 us; skew 500 ppm
Jun 18 23:23:58 dist-test-slave-r9ct krb5kdc[25587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825038, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:23:58.834502 25600 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:23:58.835014 25600 webserver.cc:460] Webserver started at http://127.3.217.190:35799/ using document root <none> and password file <none>
I20260618 23:23:58.835273 25600 fs_manager.cc:359] Metadata directory not provided
I20260618 23:23:58.835357 25600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:23:58.835510 25600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:23:58.836622 25600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "5564fb6a95dc49fa91c72b109cd75783"
format_stamp: "Formatted at 2026-06-18 23:23:58 on dist-test-slave-r9ct"
server_key: "4094bfa2d6fcce0465a8d9f82202c879"
server_key_iv: "631bd167fcfc66eff5ea8ab4d1705c42"
server_key_version: "encryptionkey@0"
I20260618 23:23:58.836993 25600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "5564fb6a95dc49fa91c72b109cd75783"
format_stamp: "Formatted at 2026-06-18 23:23:58 on dist-test-slave-r9ct"
server_key: "4094bfa2d6fcce0465a8d9f82202c879"
server_key_iv: "631bd167fcfc66eff5ea8ab4d1705c42"
server_key_version: "encryptionkey@0"
I20260618 23:23:58.838644 25600 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:23:58.839820 25615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:23:58.840263 25600 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:23:58.840379 25600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "5564fb6a95dc49fa91c72b109cd75783"
format_stamp: "Formatted at 2026-06-18 23:23:58 on dist-test-slave-r9ct"
server_key: "4094bfa2d6fcce0465a8d9f82202c879"
server_key_iv: "631bd167fcfc66eff5ea8ab4d1705c42"
server_key_version: "encryptionkey@0"
I20260618 23:23:58.840469 25600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:23:58.868055 25600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:23:58.870446 25600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:23:58.870625 25600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:23:58.874760 25600 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:43641
I20260618 23:23:58.874826 25667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:43641 every 8 connection(s)
I20260618 23:23:58.875171 25600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:23:58.876098 25668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:23:58.878405 25668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783: Bootstrap starting.
I20260618 23:23:58.879055 25668 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783: Neither blocks nor log segments found. Creating new log.
I20260618 23:23:58.879773 25668 log.cc:824] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783: Log is configured to *not* fsync() on all Append() calls
I20260618 23:23:58.880838 25668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783: No bootstrap required, opened a new log
I20260618 23:23:58.880901 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 25600
I20260618 23:23:58.881002 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:23:58.881233 3942 external_mini_cluster.cc:1428] Setting key 6abe9588fcd6e42e4f82f3d20828e253
I20260618 23:23:58.884799 25668 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5564fb6a95dc49fa91c72b109cd75783" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43641 } }
I20260618 23:23:58.884981 25668 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:23:58.885025 25668 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5564fb6a95dc49fa91c72b109cd75783, State: Initialized, Role: FOLLOWER
I20260618 23:23:58.885149 25668 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5564fb6a95dc49fa91c72b109cd75783" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43641 } }
I20260618 23:23:58.885231 25668 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:23:58.885252 25668 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:23:58.885320 25668 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:23:58.885973 25668 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5564fb6a95dc49fa91c72b109cd75783" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43641 } }
I20260618 23:23:58.886075 25668 leader_election.cc:302] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5564fb6a95dc49fa91c72b109cd75783; no voters:
I20260618 23:23:58.886248 25668 leader_election.cc:288] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:23:58.886366 25673 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:23:58.886610 25668 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:23:58.886832 25673 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783 [term 1 LEADER]: Becoming Leader. State: Replica: 5564fb6a95dc49fa91c72b109cd75783, State: Running, Role: LEADER
I20260618 23:23:58.887061 25673 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5564fb6a95dc49fa91c72b109cd75783" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43641 } }
I20260618 23:23:58.888077 25675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5564fb6a95dc49fa91c72b109cd75783. Latest consensus state: current_term: 1 leader_uuid: "5564fb6a95dc49fa91c72b109cd75783" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5564fb6a95dc49fa91c72b109cd75783" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43641 } } }
I20260618 23:23:58.888163 25675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:58.888595 25672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:58.881992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40329 (local address 127.3.217.190:43641)
0618 23:23:58.882241 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:58.882253 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:58.882292 (+ 39us) server_negotiation.cc:407] Connection header received
0618 23:23:58.882862 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:58.882871 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:58.882938 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:58.883298 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:58.883475 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:58.884905 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:58.885935 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:58.886641 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:58.886792 (+ 151us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:58.887579 (+ 787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:58.887583 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:58.887583 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:58.887803 (+ 220us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:58.887841 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:58.887856 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:58.887957 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:58.888111 (+ 154us) server_negotiation.cc:299] Negotiation successful
0618 23:23:58.888140 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":110,"threads_started":1}
I20260618 23:23:58.889030 25674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5564fb6a95dc49fa91c72b109cd75783" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5564fb6a95dc49fa91c72b109cd75783" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 43641 } } }
I20260618 23:23:58.889073 25684 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:23:58.889122 25674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783 [sys.catalog]: This master's current role is: LEADER
I20260618 23:23:58.889642 25684 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:23:58.889972 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:23:58.891449 25684 catalog_manager.cc:1347] Generated new cluster ID: 5fe88a179a62498c914cf42a05117bea
I20260618 23:23:58.891502 25684 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:23:58.894994 25672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:23:58.891507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38881 (local address 127.3.217.190:43641)
0618 23:23:58.891540 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0618 23:23:58.891542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:23:58.891701 (+ 159us) server_negotiation.cc:407] Connection header received
0618 23:23:58.891754 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:23:58.891755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:23:58.891765 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:23:58.891838 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:23:58.891958 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:58.892644 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:58.893628 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:23:58.893949 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:23:58.894021 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:23:58.894699 (+ 678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:23:58.894700 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:23:58.894700 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:23:58.894704 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:23:58.894754 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:23:58.894759 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:23:58.894825 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0618 23:23:58.894904 (+ 79us) server_negotiation.cc:299] Negotiation successful
0618 23:23:58.894915 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260618 23:23:58.922979 25684 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:23:58.923548 25684 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:23:58.929632 25684 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5564fb6a95dc49fa91c72b109cd75783: Generated new TSK 0
I20260618 23:23:58.929864 25684 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:23:58.940371 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 25600
W20260618 23:23:58.944916 25585 connection.cc:535] client connection to 127.3.217.190:43641 recv error: Network error: failed to read from TLS socket (remote: 127.3.217.190:43641): Connection reset by peer (error 104)
2026-06-18T23:23:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1372 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:23:58 dist-test-slave-r9ct krb5kdc[25699](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:23:58 dist-test-slave-r9ct krb5kdc[25699](info): set up 2 sockets
Jun 18 23:23:58 dist-test-slave-r9ct krb5kdc[25699](info): commencing operation
krb5kdc: starting...
W20260618 23:23:59.990890 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:24:00 dist-test-slave-r9ct krb5kdc[25699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:24:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:24:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:24:00.109102 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:33367
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:33367
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:24:00.198047 25712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:24:00.198257 25712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:24:00.198282 25712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:24:00.199517 25712 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:24:00.199564 25712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:24:00.199579 25712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:24:00.199591 25712 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:24:00.199604 25712 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:24:00.201606 25712 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:33367
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:33367
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25712
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:24:00.201903 25712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:24:00.202135 25712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:24:00.207252 25718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:24:00.207391 25717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:24:00.207429 25712 server_base.cc:1034] running on GCE node
W20260618 23:24:00.207315 25720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:24:00.207783 25712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:24:00.208070 25712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:24:00.209244 25712 hybrid_clock.cc:648] HybridClock initialized: now 1781825040209195 us; error 66 us; skew 500 ppm
Jun 18 23:24:00 dist-test-slave-r9ct krb5kdc[25699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825040, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:24:00.212281 25712 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:24:00.212703 25712 webserver.cc:460] Webserver started at http://127.3.217.190:35335/ using document root <none> and password file <none>
I20260618 23:24:00.212926 25712 fs_manager.cc:359] Metadata directory not provided
I20260618 23:24:00.212973 25712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:24:00.213070 25712 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:24:00.214216 25712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "f361e8891f534db184ec6c1d54229bfb"
format_stamp: "Formatted at 2026-06-18 23:24:00 on dist-test-slave-r9ct"
server_key: "5d094b04a8b0ab19cc86deb82d685fea"
server_key_iv: "ad35281acfe3c60fdcacfd16f6cf6db1"
server_key_version: "encryptionkey@0"
I20260618 23:24:00.214536 25712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "f361e8891f534db184ec6c1d54229bfb"
format_stamp: "Formatted at 2026-06-18 23:24:00 on dist-test-slave-r9ct"
server_key: "5d094b04a8b0ab19cc86deb82d685fea"
server_key_iv: "ad35281acfe3c60fdcacfd16f6cf6db1"
server_key_version: "encryptionkey@0"
I20260618 23:24:00.216087 25712 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:24:00.216889 25727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:24:00.217095 25712 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:24:00.217170 25712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "f361e8891f534db184ec6c1d54229bfb"
format_stamp: "Formatted at 2026-06-18 23:24:00 on dist-test-slave-r9ct"
server_key: "5d094b04a8b0ab19cc86deb82d685fea"
server_key_iv: "ad35281acfe3c60fdcacfd16f6cf6db1"
server_key_version: "encryptionkey@0"
I20260618 23:24:00.217226 25712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:24:00.220414 25712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:24:00.222333 25712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:24:00.222436 25712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:24:00.226011 25712 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:33367
I20260618 23:24:00.226060 25779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:33367 every 8 connection(s)
I20260618 23:24:00.226436 25712 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:24:00.227515 25780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:24:00.229784 25780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb: Bootstrap starting.
I20260618 23:24:00.230324 25780 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb: Neither blocks nor log segments found. Creating new log.
I20260618 23:24:00.230571 25780 log.cc:824] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb: Log is configured to *not* fsync() on all Append() calls
I20260618 23:24:00.231370 25780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb: No bootstrap required, opened a new log
I20260618 23:24:00.233007 25780 raft_consensus.cc:348] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f361e8891f534db184ec6c1d54229bfb" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33367 } }
I20260618 23:24:00.233146 25780 raft_consensus.cc:374] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:24:00.233170 25780 raft_consensus.cc:729] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f361e8891f534db184ec6c1d54229bfb, State: Initialized, Role: FOLLOWER
I20260618 23:24:00.233316 25780 consensus_queue.cc:260] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f361e8891f534db184ec6c1d54229bfb" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33367 } }
I20260618 23:24:00.233405 25780 raft_consensus.cc:388] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:24:00.233430 25780 raft_consensus.cc:482] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:24:00.233469 25780 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:24:00.234025 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 25712
I20260618 23:24:00.234197 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:24:00.234388 3942 external_mini_cluster.cc:1428] Setting key 7723612e829a8133e6acf492074275c0
I20260618 23:24:00.234570 25780 raft_consensus.cc:504] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f361e8891f534db184ec6c1d54229bfb" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33367 } }
I20260618 23:24:00.234664 25780 leader_election.cc:302] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f361e8891f534db184ec6c1d54229bfb; no voters:
I20260618 23:24:00.234941 25780 leader_election.cc:288] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:24:00.234987 25783 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:24:00.235224 25783 raft_consensus.cc:686] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb [term 1 LEADER]: Becoming Leader. State: Replica: f361e8891f534db184ec6c1d54229bfb, State: Running, Role: LEADER
I20260618 23:24:00.235342 25783 consensus_queue.cc:237] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f361e8891f534db184ec6c1d54229bfb" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33367 } }
I20260618 23:24:00.235351 25780 sys_catalog.cc:564] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:24:00.235656 25786 sys_catalog.cc:455] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f361e8891f534db184ec6c1d54229bfb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f361e8891f534db184ec6c1d54229bfb" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33367 } } }
I20260618 23:24:00.235733 25786 sys_catalog.cc:458] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb [sys.catalog]: This master's current role is: LEADER
I20260618 23:24:00.235832 25787 sys_catalog.cc:455] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb [sys.catalog]: SysCatalogTable state changed. Reason: New leader f361e8891f534db184ec6c1d54229bfb. Latest consensus state: current_term: 1 leader_uuid: "f361e8891f534db184ec6c1d54229bfb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f361e8891f534db184ec6c1d54229bfb" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 33367 } } }
I20260618 23:24:00.236056 25787 sys_catalog.cc:458] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb [sys.catalog]: This master's current role is: LEADER
W20260618 23:24:00.237684 25801 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260618 23:24:00.237859 25801 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260618 23:24:00.237942 25785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:00.234954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35283 (local address 127.3.217.190:33367)
0618 23:24:00.235300 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:00.235310 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:00.235575 (+ 265us) server_negotiation.cc:407] Connection header received
0618 23:24:00.235708 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:00.235716 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:00.235748 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:00.235892 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:00.237269 (+ 1377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:00.237273 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:00.237273 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:24:00.237278 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:00.237316 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:24:00.237329 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:00.237386 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:00.237550 (+ 164us) server_negotiation.cc:299] Negotiation successful
0618 23:24:00.237588 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":155,"threads_started":1}
I20260618 23:24:00.238011 25789 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:24:00.238364 25789 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:24:00.239063 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:24:00.240412 25789 catalog_manager.cc:1347] Generated new cluster ID: df43f14e761645a08dc905c5deb62e9a
I20260618 23:24:00.240474 25789 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:24:00.241673 25785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:00.240567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48661 (local address 127.3.217.190:33367)
0618 23:24:00.240601 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:00.240603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:00.240767 (+ 164us) server_negotiation.cc:407] Connection header received
0618 23:24:00.240850 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:00.240851 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:00.240855 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:00.240880 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:00.241468 (+ 588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:00.241469 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:00.241469 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:24:00.241473 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:00.241484 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:24:00.241488 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:00.241513 (+ 25us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:00.241604 (+ 91us) server_negotiation.cc:299] Negotiation successful
0618 23:24:00.241615 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260618 23:24:00.245220 25789 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:24:00.245368 25789 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:24:00.251408 25789 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f361e8891f534db184ec6c1d54229bfb: Generated new TSK 0
I20260618 23:24:00.251554 25789 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:24:00.257865 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 25712
2026-06-18T23:24:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1316 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:24:00 dist-test-slave-r9ct krb5kdc[25811](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:24:00 dist-test-slave-r9ct krb5kdc[25811](info): set up 2 sockets
Jun 18 23:24:00 dist-test-slave-r9ct krb5kdc[25811](info): commencing operation
krb5kdc: starting...
W20260618 23:24:01.306962 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.031s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:24:01 dist-test-slave-r9ct krb5kdc[25811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:24:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:24:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:24:01.433331 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:34795
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:34071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:34795
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:24:01.511190 25824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:24:01.511443 25824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:24:01.511483 25824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:24:01.512678 25824 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:24:01.512748 25824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:24:01.512776 25824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:24:01.512805 25824 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:24:01.512840 25824 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:24:01.514437 25824 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:34071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:34795
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:34795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:24:01.514672 25824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:24:01.514940 25824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:24:01.519564 25829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:24:01.519572 25832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:24:01.519582 25830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:24:01.519896 25824 server_base.cc:1034] running on GCE node
I20260618 23:24:01.520123 25824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:24:01.520390 25824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:24:01.521550 25824 hybrid_clock.cc:648] HybridClock initialized: now 1781825041521538 us; error 28 us; skew 500 ppm
Jun 18 23:24:01 dist-test-slave-r9ct krb5kdc[25811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825041, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:24:01.524086 25824 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:24:01.524510 25824 webserver.cc:460] Webserver started at http://127.3.217.190:45305/ using document root <none> and password file <none>
I20260618 23:24:01.524679 25824 fs_manager.cc:359] Metadata directory not provided
I20260618 23:24:01.524720 25824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:24:01.524801 25824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:24:01.525738 25824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "90915bd6f6f24a1388b53bdcb871c55b"
format_stamp: "Formatted at 2026-06-18 23:24:01 on dist-test-slave-r9ct"
server_key: "24123ff7ce7f8cfb0e36fee80186b14e"
server_key_iv: "0ef6d0497676a9d7ce87a62b8547fbe1"
server_key_version: "encryptionkey@0"
I20260618 23:24:01.526037 25824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "90915bd6f6f24a1388b53bdcb871c55b"
format_stamp: "Formatted at 2026-06-18 23:24:01 on dist-test-slave-r9ct"
server_key: "24123ff7ce7f8cfb0e36fee80186b14e"
server_key_iv: "0ef6d0497676a9d7ce87a62b8547fbe1"
server_key_version: "encryptionkey@0"
I20260618 23:24:01.527403 25824 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:24:01.528142 25839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:24:01.528519 25824 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:24:01.528683 25824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "90915bd6f6f24a1388b53bdcb871c55b"
format_stamp: "Formatted at 2026-06-18 23:24:01 on dist-test-slave-r9ct"
server_key: "24123ff7ce7f8cfb0e36fee80186b14e"
server_key_iv: "0ef6d0497676a9d7ce87a62b8547fbe1"
server_key_version: "encryptionkey@0"
I20260618 23:24:01.528779 25824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:24:01.550611 25824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:24:01.552898 25824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:24:01.553009 25824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:24:01.556699 25824 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:34795
I20260618 23:24:01.556800 25891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:34795 every 8 connection(s)
I20260618 23:24:01.557085 25824 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:24:01.557765 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 25824
I20260618 23:24:01.557893 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:24:01.558107 3942 external_mini_cluster.cc:1428] Setting key 0e3815dde455a6d1241cd4c22bac9b64
I20260618 23:24:01.558254 25892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:24:01.560999 25892 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b: Bootstrap starting.
I20260618 23:24:01.561702 25892 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b: Neither blocks nor log segments found. Creating new log.
I20260618 23:24:01.562002 25892 log.cc:824] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b: Log is configured to *not* fsync() on all Append() calls
I20260618 23:24:01.562757 25892 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b: No bootstrap required, opened a new log
I20260618 23:24:01.564751 25892 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90915bd6f6f24a1388b53bdcb871c55b" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34795 } }
I20260618 23:24:01.564909 25892 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:24:01.564970 25892 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90915bd6f6f24a1388b53bdcb871c55b, State: Initialized, Role: FOLLOWER
I20260618 23:24:01.565100 25892 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90915bd6f6f24a1388b53bdcb871c55b" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34795 } }
Jun 18 23:24:01 dist-test-slave-r9ct krb5kdc[25811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:24:01.565196 25892 raft_consensus.cc:388] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:24:01.565258 25892 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:24:01.565305 25892 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:24:01.565918 25892 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90915bd6f6f24a1388b53bdcb871c55b" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34795 } }
I20260618 23:24:01.566037 25892 leader_election.cc:302] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90915bd6f6f24a1388b53bdcb871c55b; no voters:
I20260618 23:24:01.566216 25892 leader_election.cc:288] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:24:01.566371 25898 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:24:01.566476 25892 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:24:01.566519 25898 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b [term 1 LEADER]: Becoming Leader. State: Replica: 90915bd6f6f24a1388b53bdcb871c55b, State: Running, Role: LEADER
I20260618 23:24:01.566609 25898 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90915bd6f6f24a1388b53bdcb871c55b" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34795 } }
I20260618 23:24:01.566960 25899 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90915bd6f6f24a1388b53bdcb871c55b. Latest consensus state: current_term: 1 leader_uuid: "90915bd6f6f24a1388b53bdcb871c55b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90915bd6f6f24a1388b53bdcb871c55b" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34795 } } }
I20260618 23:24:01.567162 25899 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b [sys.catalog]: This master's current role is: LEADER
I20260618 23:24:01.567092 25897 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "90915bd6f6f24a1388b53bdcb871c55b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90915bd6f6f24a1388b53bdcb871c55b" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 34795 } } }
I20260618 23:24:01.567400 25897 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b [sys.catalog]: This master's current role is: LEADER
I20260618 23:24:01.567786 25901 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:24:01.568341 25901 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:24:01.569804 25901 catalog_manager.cc:1347] Generated new cluster ID: c3439c3784bd494c84d2c0b8e1d7dd82
I20260618 23:24:01.569856 25901 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:24:01.570240 25895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:01.558598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48763 (local address 127.3.217.190:34795)
0618 23:24:01.558807 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:01.558816 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:01.558851 (+ 35us) server_negotiation.cc:407] Connection header received
0618 23:24:01.559300 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:01.559306 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:01.559347 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:01.559488 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:01.560094 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:01.561016 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:01.562186 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:01.562753 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:01.562870 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:01.565746 (+ 2876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:01.565750 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:01.565750 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:01.565761 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:01.567913 (+ 2152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:01.568341 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:01.568343 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:01.568343 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:01.568677 (+ 334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:01.568911 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:01.568912 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:01.568912 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:01.569196 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:01.569855 (+ 659us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:01.569926 (+ 71us) server_negotiation.cc:299] Negotiation successful
0618 23:24:01.570056 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":126,"threads_started":1}
I20260618 23:24:01.571166 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:24:01.582171 25895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:01.575023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58893 (local address 127.3.217.190:34795)
0618 23:24:01.575060 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:01.575062 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:01.575210 (+ 148us) server_negotiation.cc:407] Connection header received
0618 23:24:01.575295 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:01.575296 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:01.575305 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:01.575360 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:01.575994 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:01.576701 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:01.577682 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:01.578014 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:01.578074 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:01.579504 (+ 1430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:01.579505 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:01.579506 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:01.579512 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:01.581040 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:01.581423 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:01.581424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:01.581424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:01.581480 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:01.581678 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:01.581679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:01.581679 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:01.581796 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:01.581891 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:01.582013 (+ 122us) server_negotiation.cc:299] Negotiation successful
0618 23:24:01.582079 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260618 23:24:01.583915 25901 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:24:01.584396 25901 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:24:01.590107 25901 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 90915bd6f6f24a1388b53bdcb871c55b: Generated new TSK 0
I20260618 23:24:01.590286 25901 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:24:01.594627 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 25824
2026-06-18T23:24:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1337 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:24:01 dist-test-slave-r9ct krb5kdc[25923](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:24:01 dist-test-slave-r9ct krb5kdc[25923](info): set up 2 sockets
Jun 18 23:24:01 dist-test-slave-r9ct krb5kdc[25923](info): commencing operation
krb5kdc: starting...
W20260618 23:24:02.647311 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.034s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:24:02 dist-test-slave-r9ct krb5kdc[25923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:24:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:24:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:24:02.766664 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:37377
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:35941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:37377
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:24:02.844798 25936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:24:02.845024 25936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:24:02.845060 25936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:24:02.846186 25936 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:24:02.846269 25936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:24:02.846297 25936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:24:02.846326 25936 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:24:02.846350 25936 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:24:02.847782 25936 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:35941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:37377
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:37377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25936
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:24:02.848045 25936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:24:02.848271 25936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:24:02.853487 25941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:24:02.853538 25944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:24:02.853462 25942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:24:02.853582 25936 server_base.cc:1034] running on GCE node
I20260618 23:24:02.853793 25936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:24:02.854046 25936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:24:02.855201 25936 hybrid_clock.cc:648] HybridClock initialized: now 1781825042855179 us; error 38 us; skew 500 ppm
Jun 18 23:24:02 dist-test-slave-r9ct krb5kdc[25923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825042, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:24:02.862980 25936 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:24:02.863430 25936 webserver.cc:460] Webserver started at http://127.3.217.190:42163/ using document root <none> and password file <none>
I20260618 23:24:02.863664 25936 fs_manager.cc:359] Metadata directory not provided
I20260618 23:24:02.863708 25936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:24:02.863884 25936 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:24:02.864908 25936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "8c31d5d3d5b64490bb62e7ada7eb6f76"
format_stamp: "Formatted at 2026-06-18 23:24:02 on dist-test-slave-r9ct"
server_key: "42dbd0a689780a02c2f1bf470f0a2ad2"
server_key_iv: "4be543e9987bf7cd8f5fff0d9f8dc8dc"
server_key_version: "encryptionkey@0"
I20260618 23:24:02.865281 25936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "8c31d5d3d5b64490bb62e7ada7eb6f76"
format_stamp: "Formatted at 2026-06-18 23:24:02 on dist-test-slave-r9ct"
server_key: "42dbd0a689780a02c2f1bf470f0a2ad2"
server_key_iv: "4be543e9987bf7cd8f5fff0d9f8dc8dc"
server_key_version: "encryptionkey@0"
I20260618 23:24:02.866653 25936 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:24:02.867729 25951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:24:02.868026 25936 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:24:02.868134 25936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "8c31d5d3d5b64490bb62e7ada7eb6f76"
format_stamp: "Formatted at 2026-06-18 23:24:02 on dist-test-slave-r9ct"
server_key: "42dbd0a689780a02c2f1bf470f0a2ad2"
server_key_iv: "4be543e9987bf7cd8f5fff0d9f8dc8dc"
server_key_version: "encryptionkey@0"
I20260618 23:24:02.868227 25936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:24:02.881932 25936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:24:02.884313 25936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:24:02.884477 25936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:24:02.888831 25936 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:37377
I20260618 23:24:02.888896 26003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:37377 every 8 connection(s)
I20260618 23:24:02.889257 25936 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:24:02.890094 26004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:24:02.891702 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 25936
I20260618 23:24:02.891840 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:24:02.892040 3942 external_mini_cluster.cc:1428] Setting key 68f1fa8ca3522028e8db956d252000f8
I20260618 23:24:02.892519 26004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76: Bootstrap starting.
I20260618 23:24:02.893193 26004 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76: Neither blocks nor log segments found. Creating new log.
I20260618 23:24:02.893509 26004 log.cc:824] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76: Log is configured to *not* fsync() on all Append() calls
I20260618 23:24:02.894146 26004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76: No bootstrap required, opened a new log
I20260618 23:24:02.895923 26004 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c31d5d3d5b64490bb62e7ada7eb6f76" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37377 } }
I20260618 23:24:02.896046 26004 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:24:02.896068 26004 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c31d5d3d5b64490bb62e7ada7eb6f76, State: Initialized, Role: FOLLOWER
I20260618 23:24:02.896219 26004 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c31d5d3d5b64490bb62e7ada7eb6f76" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37377 } }
I20260618 23:24:02.896306 26004 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:24:02.896356 26004 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:24:02.896427 26004 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:24:02.896922 26004 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c31d5d3d5b64490bb62e7ada7eb6f76" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37377 } }
I20260618 23:24:02.897034 26004 leader_election.cc:302] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c31d5d3d5b64490bb62e7ada7eb6f76; no voters:
I20260618 23:24:02.897224 26004 leader_election.cc:288] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:24:02.897244 26009 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:24:02.897423 26009 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76 [term 1 LEADER]: Becoming Leader. State: Replica: 8c31d5d3d5b64490bb62e7ada7eb6f76, State: Running, Role: LEADER
I20260618 23:24:02.897475 26004 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:24:02.897512 26009 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c31d5d3d5b64490bb62e7ada7eb6f76" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37377 } }
I20260618 23:24:02.897696 26007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:02.892544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34613 (local address 127.3.217.190:37377)
0618 23:24:02.892707 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:02.892716 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:02.892746 (+ 30us) server_negotiation.cc:407] Connection header received
0618 23:24:02.893366 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:02.893376 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:02.893437 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:02.893585 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:02.893867 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:02.894898 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:02.895669 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:02.896092 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:02.896198 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:02.896909 (+ 711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:02.896913 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:02.896913 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:24:02.897118 (+ 205us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:02.897154 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:24:02.897167 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:02.897249 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:02.897328 (+ 79us) server_negotiation.cc:299] Negotiation successful
0618 23:24:02.897391 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":80,"threads_started":1}
I20260618 23:24:02.897863 26009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c31d5d3d5b64490bb62e7ada7eb6f76. Latest consensus state: current_term: 1 leader_uuid: "8c31d5d3d5b64490bb62e7ada7eb6f76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c31d5d3d5b64490bb62e7ada7eb6f76" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37377 } } }
I20260618 23:24:02.897869 26010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c31d5d3d5b64490bb62e7ada7eb6f76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c31d5d3d5b64490bb62e7ada7eb6f76" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 37377 } } }
I20260618 23:24:02.897962 26009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76 [sys.catalog]: This master's current role is: LEADER
I20260618 23:24:02.898137 26010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76 [sys.catalog]: This master's current role is: LEADER
I20260618 23:24:02.898702 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:24:02.898684 26017 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:24:02.899295 26017 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:24:02.901288 26017 catalog_manager.cc:1347] Generated new cluster ID: 50516e1d093749438f49083ba80fbdf0
I20260618 23:24:02.901330 26017 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:24:02.904997 26007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:02.900220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59227 (local address 127.3.217.190:37377)
0618 23:24:02.900278 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:02.900280 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:02.900395 (+ 115us) server_negotiation.cc:407] Connection header received
0618 23:24:02.900465 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:02.900465 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:02.900476 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:02.900532 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:02.900689 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:02.901208 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:02.903683 (+ 2475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:02.903987 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:02.904066 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:02.904759 (+ 693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:02.904760 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:02.904761 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:24:02.904766 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:02.904784 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:24:02.904788 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:02.904852 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:02.904910 (+ 58us) server_negotiation.cc:299] Negotiation successful
0618 23:24:02.904929 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260618 23:24:02.915616 26017 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:24:02.916311 26017 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:24:02.923951 26017 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8c31d5d3d5b64490bb62e7ada7eb6f76: Generated new TSK 0
I20260618 23:24:02.924134 26017 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:24:02.933085 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 25936
2026-06-18T23:24:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1338 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:24:02 dist-test-slave-r9ct krb5kdc[26035](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:24:02 dist-test-slave-r9ct krb5kdc[26035](info): set up 2 sockets
Jun 18 23:24:02 dist-test-slave-r9ct krb5kdc[26035](info): commencing operation
krb5kdc: starting...
W20260618 23:24:03.979074 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.027s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:24:04 dist-test-slave-r9ct krb5kdc[26035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825044, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:24:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:24:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:24:04.101905 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:45237
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:41647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:45237
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:24:04.186146 26048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:24:04.186374 26048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:24:04.186414 26048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:24:04.187546 26048 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:24:04.187615 26048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:24:04.187644 26048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:24:04.187673 26048 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:24:04.187702 26048 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:24:04.189153 26048 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:41647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:45237
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:45237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26048
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:24:04.189415 26048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:24:04.189647 26048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:24:04.194545 26054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:24:04.194604 26048 server_base.cc:1034] running on GCE node
W20260618 23:24:04.194526 26053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:24:04.194587 26056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:24:04.195009 26048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:24:04.195292 26048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:24:04.196468 26048 hybrid_clock.cc:648] HybridClock initialized: now 1781825044196441 us; error 37 us; skew 500 ppm
Jun 18 23:24:04 dist-test-slave-r9ct krb5kdc[26035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825044, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:24:04.198967 26048 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:24:04.199324 26048 webserver.cc:460] Webserver started at http://127.3.217.190:39501/ using document root <none> and password file <none>
I20260618 23:24:04.199504 26048 fs_manager.cc:359] Metadata directory not provided
I20260618 23:24:04.199542 26048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:24:04.199622 26048 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:24:04.200531 26048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "05e0663bf27a49bfb8c356f05a1bde7e"
format_stamp: "Formatted at 2026-06-18 23:24:04 on dist-test-slave-r9ct"
server_key: "014f633a78eaef1729d7c6ef2314efec"
server_key_iv: "e9563cdbc719343f5525751e29aed94c"
server_key_version: "encryptionkey@0"
I20260618 23:24:04.200816 26048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "05e0663bf27a49bfb8c356f05a1bde7e"
format_stamp: "Formatted at 2026-06-18 23:24:04 on dist-test-slave-r9ct"
server_key: "014f633a78eaef1729d7c6ef2314efec"
server_key_iv: "e9563cdbc719343f5525751e29aed94c"
server_key_version: "encryptionkey@0"
I20260618 23:24:04.201996 26048 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260618 23:24:04.202652 26063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:24:04.202850 26048 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260618 23:24:04.202920 26048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "05e0663bf27a49bfb8c356f05a1bde7e"
format_stamp: "Formatted at 2026-06-18 23:24:04 on dist-test-slave-r9ct"
server_key: "014f633a78eaef1729d7c6ef2314efec"
server_key_iv: "e9563cdbc719343f5525751e29aed94c"
server_key_version: "encryptionkey@0"
I20260618 23:24:04.203001 26048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:24:04.206001 26048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:24:04.208245 26048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:24:04.208400 26048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:24:04.212108 26048 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:45237
I20260618 23:24:04.212149 26115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:45237 every 8 connection(s)
I20260618 23:24:04.212469 26048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:24:04.213402 26116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:24:04.215507 26116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e: Bootstrap starting.
I20260618 23:24:04.216029 26116 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e: Neither blocks nor log segments found. Creating new log.
I20260618 23:24:04.216301 26116 log.cc:824] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e: Log is configured to *not* fsync() on all Append() calls
I20260618 23:24:04.216521 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 26048
I20260618 23:24:04.216634 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:24:04.216845 3942 external_mini_cluster.cc:1428] Setting key 2b65491052c0c53d03fdecc5093ec5c6
I20260618 23:24:04.217327 26116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e: No bootstrap required, opened a new log
I20260618 23:24:04.219374 26116 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e0663bf27a49bfb8c356f05a1bde7e" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45237 } }
I20260618 23:24:04.219533 26116 raft_consensus.cc:374] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 23:24:04.219578 26116 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05e0663bf27a49bfb8c356f05a1bde7e, State: Initialized, Role: FOLLOWER
I20260618 23:24:04.219695 26116 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e0663bf27a49bfb8c356f05a1bde7e" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45237 } }
I20260618 23:24:04.219810 26116 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 23:24:04.219849 26116 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 23:24:04.219904 26116 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:24:04.220548 26120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:04.217401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33397 (local address 127.3.217.190:45237)
0618 23:24:04.217842 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:04.217849 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:04.217886 (+ 37us) server_negotiation.cc:407] Connection header received
0618 23:24:04.219359 (+ 1473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:04.219366 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:04.219393 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:04.219532 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:04.220149 (+ 617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:04.220152 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:04.220152 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:24:04.220156 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:04.220197 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:24:04.220207 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:04.220281 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:04.220344 (+ 63us) server_negotiation.cc:299] Negotiation successful
0618 23:24:04.220382 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":288,"threads_started":1}
I20260618 23:24:04.220925 26116 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e0663bf27a49bfb8c356f05a1bde7e" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45237 } }
I20260618 23:24:04.221009 26116 leader_election.cc:302] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05e0663bf27a49bfb8c356f05a1bde7e; no voters:
I20260618 23:24:04.221199 26116 leader_election.cc:288] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 23:24:04.221271 26121 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:24:04.221403 26121 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e [term 1 LEADER]: Becoming Leader. State: Replica: 05e0663bf27a49bfb8c356f05a1bde7e, State: Running, Role: LEADER
I20260618 23:24:04.221480 26116 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:24:04.221529 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:24:04.221487 26121 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e0663bf27a49bfb8c356f05a1bde7e" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45237 } }
I20260618 23:24:04.221798 26123 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05e0663bf27a49bfb8c356f05a1bde7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e0663bf27a49bfb8c356f05a1bde7e" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45237 } } }
I20260618 23:24:04.221801 26121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05e0663bf27a49bfb8c356f05a1bde7e. Latest consensus state: current_term: 1 leader_uuid: "05e0663bf27a49bfb8c356f05a1bde7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05e0663bf27a49bfb8c356f05a1bde7e" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 45237 } } }
I20260618 23:24:04.221959 26123 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e [sys.catalog]: This master's current role is: LEADER
I20260618 23:24:04.221982 26121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e [sys.catalog]: This master's current role is: LEADER
I20260618 23:24:04.222689 26130 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:24:04.223192 26130 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:24:04.224942 26130 catalog_manager.cc:1347] Generated new cluster ID: c9d14ae80cac4ffaa8c9250e844fc438
I20260618 23:24:04.225001 26130 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:24:04.225072 26120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:04.223873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48805 (local address 127.3.217.190:45237)
0618 23:24:04.223911 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:04.223913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:04.224023 (+ 110us) server_negotiation.cc:407] Connection header received
0618 23:24:04.224082 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:04.224083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:04.224087 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:04.224146 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:04.224744 (+ 598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:04.224745 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:04.224746 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0618 23:24:04.224750 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:04.224762 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0618 23:24:04.224766 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:04.224795 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:04.224903 (+ 108us) server_negotiation.cc:299] Negotiation successful
0618 23:24:04.224917 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260618 23:24:04.266180 26130 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:24:04.266368 26130 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:24:04.273840 26130 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05e0663bf27a49bfb8c356f05a1bde7e: Generated new TSK 0
I20260618 23:24:04.274036 26130 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260618 23:24:04.279724 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 26048
2026-06-18T23:24:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1345 ms)
[----------] 18 tests from AuthTokenIssuingTest (24319 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:24:04 dist-test-slave-r9ct krb5kdc[26147](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:24:04 dist-test-slave-r9ct krb5kdc[26147](info): set up 2 sockets
Jun 18 23:24:04 dist-test-slave-r9ct krb5kdc[26147](info): commencing operation
krb5kdc: starting...
W20260618 23:24:05.347010 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.049s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:24:05 dist-test-slave-r9ct krb5kdc[26147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:24:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:24:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:24:05.477929 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:38015
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:38015,127.3.217.189:36729,127.3.217.188:46065
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:24:05.556484 26160 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260618 23:24:05.556802 26160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:24:05.556833 26160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:24:05.556875 26160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:24:05.557955 26160 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:24:05.558024 26160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:24:05.558050 26160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:24:05.558080 26160 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:24:05.558110 26160 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:24:05.559579 26160 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:38015,127.3.217.189:36729,127.3.217.188:46065
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:38015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26160
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:24:05.559854 26160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:24:05.560073 26160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:24:05.564850 26165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:24:05.564870 26168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:24:05.564872 26166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:24:05.565138 26160 server_base.cc:1034] running on GCE node
I20260618 23:24:05.565359 26160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:24:05.565629 26160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:24:05.566813 26160 hybrid_clock.cc:648] HybridClock initialized: now 1781825045566806 us; error 41 us; skew 500 ppm
Jun 18 23:24:05 dist-test-slave-r9ct krb5kdc[26147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825045, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:24:05.569391 26160 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:24:05.569923 26160 webserver.cc:460] Webserver started at http://127.3.217.190:39811/ using document root <none> and password file <none>
I20260618 23:24:05.570153 26160 fs_manager.cc:359] Metadata directory not provided
I20260618 23:24:05.570200 26160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:24:05.570374 26160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:24:05.571468 26160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "503c2ba5566246bc8b15553d4da3dfc8"
format_stamp: "Formatted at 2026-06-18 23:24:05 on dist-test-slave-r9ct"
server_key: "1976d5d3180ca41a14db9de2126ea071"
server_key_iv: "98a61fc6330b890c14871695b713cb07"
server_key_version: "encryptionkey@0"
I20260618 23:24:05.571806 26160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "503c2ba5566246bc8b15553d4da3dfc8"
format_stamp: "Formatted at 2026-06-18 23:24:05 on dist-test-slave-r9ct"
server_key: "1976d5d3180ca41a14db9de2126ea071"
server_key_iv: "98a61fc6330b890c14871695b713cb07"
server_key_version: "encryptionkey@0"
I20260618 23:24:05.573123 26160 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260618 23:24:05.574026 26175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:24:05.574513 26160 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:24:05.574633 26160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "503c2ba5566246bc8b15553d4da3dfc8"
format_stamp: "Formatted at 2026-06-18 23:24:05 on dist-test-slave-r9ct"
server_key: "1976d5d3180ca41a14db9de2126ea071"
server_key_iv: "98a61fc6330b890c14871695b713cb07"
server_key_version: "encryptionkey@0"
I20260618 23:24:05.574765 26160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:24:05.588389 26160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:24:05.590608 26160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:24:05.590794 26160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:24:05.595230 26160 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:38015
I20260618 23:24:05.595325 26227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:38015 every 8 connection(s)
I20260618 23:24:05.595640 26160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:24:05.596630 26228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:24:05.598219 26228 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38015 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:24:05.603287 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 26160
I20260618 23:24:05.603377 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:24:05.603590 3942 external_mini_cluster.cc:1428] Setting key 335cfff932268e303ef1b7c838448a5b
Jun 18 23:24:05 dist-test-slave-r9ct krb5kdc[26147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825045, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:24:05.607920 26230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.598922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:38015 (local address 127.0.0.1:35634)
0618 23:24:05.599103 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.599163 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0618 23:24:05.599651 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:24:05.599939 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:24:05.599941 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:24:05.600220 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:24:05.600372 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:05.600376 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.601399 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.601400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:05.602044 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:05.602046 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.602542 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.602543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:05.602605 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:05.603134 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:24:05.603144 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:24:05.604595 (+ 1451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:24:05.606401 (+ 1806us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:05.606407 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:05.606409 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:05.606634 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:05.606965 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:05.606966 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:05.606966 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:05.607043 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:05.607504 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:24:05.607509 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:24:05.607565 (+ 56us) client_negotiation.cc:769] Sending connection context
0618 23:24:05.607639 (+ 74us) client_negotiation.cc:240] Negotiation successful
0618 23:24:05.607759 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":76,"threads_started":1}
I20260618 23:24:05.608024 26231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.599076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35634 (local address 127.3.217.190:38015)
0618 23:24:05.599190 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:05.599195 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:05.599258 (+ 63us) server_negotiation.cc:407] Connection header received
0618 23:24:05.599815 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:05.599818 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:05.599840 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:05.599934 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:05.600480 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.601285 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.602146 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.602433 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.602560 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:05.604701 (+ 2141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:05.604708 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:05.604708 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:05.604714 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:05.606280 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:05.606761 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:05.606765 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:05.606765 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:05.606881 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:05.607112 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:05.607113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:05.607113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:05.607428 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:05.607522 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:05.607708 (+ 186us) server_negotiation.cc:299] Negotiation successful
0618 23:24:05.607849 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":89,"thread_start_us":47,"threads_started":1}
I20260618 23:24:05.608716 26228 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:24:05.609043 26230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.608928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:36729 (local address 127.0.0.1:55562)
0618 23:24:05.608977 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.609020 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.189:36729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260618 23:24:05.609166 26177 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.217.189:36729: connect: Connection refused (error 111)
I20260618 23:24:05.609611 26230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.609513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:36729 (local address 127.0.0.1:55572)
0618 23:24:05.609563 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.609586 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.189:36729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260618 23:24:05.609704 26228 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.189:36729: Network error: Client connection negotiation failed: client connection to 127.3.217.189:36729: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.3.217.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.189.keytab.
Entry for principal kudu/127.3.217.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.189.keytab.
I20260618 23:24:05.627748 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.189:36729
--webserver_interface=127.3.217.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.189.keytab
--principal=kudu/127.3.217.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:38015,127.3.217.189:36729,127.3.217.188:46065
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260618 23:24:05.658943 26228 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } attempt: 1
I20260618 23:24:05.659436 26230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.659308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:36729 (local address 127.0.0.1:55578)
0618 23:24:05.659371 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.659410 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.189:36729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260618 23:24:05.659786 26230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.659692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:36729 (local address 127.0.0.1:55588)
0618 23:24:05.659738 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.659763 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.189:36729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260618 23:24:05.659871 26228 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.189:36729: Network error: Client connection negotiation failed: client connection to 127.3.217.189:36729: connect: Connection refused (error 111)
W20260618 23:24:05.712710 26235 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260618 23:24:05.712961 26235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:24:05.712996 26235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:24:05.713039 26235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:24:05.714169 26235 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:24:05.714241 26235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:24:05.714274 26235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:24:05.714304 26235 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:24:05.714332 26235 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:24:05.715860 26235 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:38015,127.3.217.189:36729,127.3.217.188:46065
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.189.keytab
--principal=kudu/127.3.217.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.189:36729
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.3.217.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26235
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:24:05.716140 26235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:24:05.716373 26235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:24:05.721414 26241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:24:05.721549 26240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:24:05.721417 26243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:24:05.721674 26235 server_base.cc:1034] running on GCE node
I20260618 23:24:05.721952 26235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:24:05.722242 26235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:24:05.723444 26235 hybrid_clock.cc:648] HybridClock initialized: now 1781825045723399 us; error 64 us; skew 500 ppm
Jun 18 23:24:05 dist-test-slave-r9ct krb5kdc[26147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825045, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:24:05.726789 26235 init.cc:377] Logged in from keytab as kudu/127.3.217.189@KRBTEST.COM (short username kudu)
I20260618 23:24:05.727288 26235 webserver.cc:460] Webserver started at http://127.3.217.189:46493/ using document root <none> and password file <none>
I20260618 23:24:05.727540 26235 fs_manager.cc:359] Metadata directory not provided
I20260618 23:24:05.727609 26235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:24:05.727766 26235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:24:05.728026 26228 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } attempt: 2
I20260618 23:24:05.728480 26230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.728351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:36729 (local address 127.0.0.1:55598)
0618 23:24:05.728413 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.728445 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.189:36729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260618 23:24:05.728775 26230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.728686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:36729 (local address 127.0.0.1:55602)
0618 23:24:05.728732 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.728756 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.189:36729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260618 23:24:05.728860 26228 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.189:36729: Network error: Client connection negotiation failed: client connection to 127.3.217.189:36729: connect: Connection refused (error 111)
I20260618 23:24:05.729070 26235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-1/data/instance:
uuid: "2b85d2474f344800985d6320b6904ec8"
format_stamp: "Formatted at 2026-06-18 23:24:05 on dist-test-slave-r9ct"
server_key: "7394f8dfcf75b6cf7a166b9dd1899b54"
server_key_iv: "2a7fb4900f9aa749e6df6511a5abe8a4"
server_key_version: "encryptionkey@0"
I20260618 23:24:05.729434 26235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-1/wal/instance:
uuid: "2b85d2474f344800985d6320b6904ec8"
format_stamp: "Formatted at 2026-06-18 23:24:05 on dist-test-slave-r9ct"
server_key: "7394f8dfcf75b6cf7a166b9dd1899b54"
server_key_iv: "2a7fb4900f9aa749e6df6511a5abe8a4"
server_key_version: "encryptionkey@0"
I20260618 23:24:05.730860 26235 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:24:05.731703 26250 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:24:05.732030 26235 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:24:05.732168 26235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-1/wal
uuid: "2b85d2474f344800985d6320b6904ec8"
format_stamp: "Formatted at 2026-06-18 23:24:05 on dist-test-slave-r9ct"
server_key: "7394f8dfcf75b6cf7a166b9dd1899b54"
server_key_iv: "2a7fb4900f9aa749e6df6511a5abe8a4"
server_key_version: "encryptionkey@0"
I20260618 23:24:05.732254 26235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:24:05.769197 26235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:24:05.772166 26235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:24:05.772379 26235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:24:05.777331 26235 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.189:36729
I20260618 23:24:05.777408 26302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.189:36729 every 8 connection(s)
I20260618 23:24:05.777868 26235 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-1/data/info.pb
I20260618 23:24:05.779284 26303 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:24:05.781329 26303 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38015 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:24:05.783255 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 26235
I20260618 23:24:05.783365 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-1/wal/instance
I20260618 23:24:05.783560 3942 external_mini_cluster.cc:1428] Setting key 59bed2f5e55f9ce5503c41b7fba3b17e
Jun 18 23:24:05 dist-test-slave-r9ct krb5kdc[26147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825045, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.189@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.3.217.188@KRBTEST.COM; defaulting to no policy
I20260618 23:24:05.792300 26231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.782097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35646 (local address 127.3.217.190:38015)
0618 23:24:05.782182 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:05.782185 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:05.782373 (+ 188us) server_negotiation.cc:407] Connection header received
0618 23:24:05.782943 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:05.782944 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:05.782957 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:05.783016 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:05.784036 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.784606 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.785842 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.786263 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.786349 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:05.789061 (+ 2712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:05.789062 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:05.789063 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:05.789071 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:05.790941 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:05.791366 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:05.791367 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:05.791368 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:05.791431 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:05.791660 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:05.791661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:05.791661 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:05.791851 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:05.791936 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:05.792161 (+ 225us) server_negotiation.cc:299] Negotiation successful
0618 23:24:05.792237 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260618 23:24:05.792510 26305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.782049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:38015 (local address 127.0.0.1:35646)
0618 23:24:05.782233 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.782280 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0618 23:24:05.782828 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:24:05.783116 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:24:05.783120 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:24:05.783521 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:24:05.783852 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:05.783858 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.784744 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.784745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:05.785732 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:05.785734 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.786390 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.786392 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:05.786534 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:05.787271 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:24:05.787279 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:24:05.788962 (+ 1683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:24:05.791035 (+ 2073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:05.791041 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:05.791043 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:05.791282 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:05.791501 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:05.791501 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:05.791502 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:05.791593 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:05.791925 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:24:05.791930 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:24:05.792044 (+ 114us) client_negotiation.cc:769] Sending connection context
0618 23:24:05.792129 (+ 85us) client_negotiation.cc:240] Negotiation successful
0618 23:24:05.792245 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":106,"threads_started":1}
I20260618 23:24:05.793078 26303 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.188@KRBTEST.COM" created.
Jun 18 23:24:05 dist-test-slave-r9ct krb5kdc[26147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825045, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.189@KRBTEST.COM for kudu/127.3.217.189@KRBTEST.COM
I20260618 23:24:05.801630 26305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.793353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:36729 (local address 127.0.0.1:55608)
0618 23:24:05.793404 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.793414 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:24:05.793455 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:24:05.793788 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:24:05.793789 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:24:05.793973 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:24:05.794026 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:05.794028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.795026 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.795027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:05.795505 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:05.795506 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.796208 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.796209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:05.796288 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:05.796688 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:24:05.796694 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:24:05.798535 (+ 1841us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:24:05.800561 (+ 2026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:05.800562 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:05.800562 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:05.800731 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:05.800950 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:05.800951 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:05.800951 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:05.801004 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:05.801291 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:24:05.801292 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:24:05.801331 (+ 39us) client_negotiation.cc:769] Sending connection context
0618 23:24:05.801390 (+ 59us) client_negotiation.cc:240] Negotiation successful
0618 23:24:05.801498 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260618 23:24:05.801662 26307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.793409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55608 (local address 127.3.217.189:36729)
0618 23:24:05.793577 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:05.793581 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:05.793596 (+ 15us) server_negotiation.cc:407] Connection header received
0618 23:24:05.793615 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:05.793616 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:05.793627 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:05.793742 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:05.794101 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.794920 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.795599 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.796129 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.796203 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:05.798637 (+ 2434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:05.798644 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:05.798644 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:05.798651 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:05.800451 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:05.800823 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:05.800826 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:05.800826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:05.800885 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:05.801071 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:05.801072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:05.801072 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:05.801222 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:05.801313 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:05.801428 (+ 115us) server_negotiation.cc:299] Negotiation successful
0618 23:24:05.801551 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":137,"thread_start_us":83,"threads_started":1}
I20260618 23:24:05.802557 26303 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:24:05.802948 26305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.802834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:46065 (local address 127.0.0.1:39124)
0618 23:24:05.802889 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.802930 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:46065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260618 23:24:05.803088 26252 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.217.188:46065: connect: Connection refused (error 111)
I20260618 23:24:05.803601 26305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.803523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:46065 (local address 127.0.0.1:39126)
0618 23:24:05.803551 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.803582 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:46065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260618 23:24:05.803728 26303 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.188:46065: Network error: Client connection negotiation failed: client connection to 127.3.217.188:46065: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.188.keytab.
Entry for principal kudu/127.3.217.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.188.keytab.
I20260618 23:24:05.814097 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.188:46065
--webserver_interface=127.3.217.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.188.keytab
--principal=kudu/127.3.217.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:43995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:38015,127.3.217.189:36729,127.3.217.188:46065
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260618 23:24:05.820010 26228 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } attempt: 3
Jun 18 23:24:05 dist-test-slave-r9ct krb5kdc[26147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825045, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for kudu/127.3.217.189@KRBTEST.COM
I20260618 23:24:05.827140 26230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.820485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:36729 (local address 127.0.0.1:55624)
0618 23:24:05.820550 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.820560 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:24:05.820631 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:24:05.820783 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:24:05.820784 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:24:05.820951 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:24:05.821018 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:05.821019 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.821661 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.821663 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:05.822181 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:05.822182 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.822563 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.822564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:05.822642 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:05.823269 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:24:05.823274 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:24:05.824439 (+ 1165us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:24:05.826019 (+ 1580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:05.826021 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:05.826021 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:05.826208 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:05.826437 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:05.826438 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:05.826439 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:05.826501 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:05.826805 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:24:05.826806 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:24:05.826855 (+ 49us) client_negotiation.cc:769] Sending connection context
0618 23:24:05.826936 (+ 81us) client_negotiation.cc:240] Negotiation successful
0618 23:24:05.827040 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260618 23:24:05.827140 26307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.820558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55624 (local address 127.3.217.189:36729)
0618 23:24:05.820626 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:05.820629 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:05.820640 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:24:05.820692 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:05.820693 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:05.820706 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:05.820778 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:05.821097 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.821581 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.822266 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.822491 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.822566 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:05.824525 (+ 1959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:05.824526 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:05.824527 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:05.824534 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:05.825904 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:05.826306 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:05.826307 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:05.826307 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:05.826365 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:05.826569 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:05.826570 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:05.826570 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:05.826685 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:05.826812 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:05.826975 (+ 163us) server_negotiation.cc:299] Negotiation successful
0618 23:24:05.827044 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260618 23:24:05.827549 26228 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:24:05.827893 26230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.827794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:46065 (local address 127.0.0.1:39128)
0618 23:24:05.827843 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.827870 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:46065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260618 23:24:05.828233 26230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.828148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:46065 (local address 127.0.0.1:39144)
0618 23:24:05.828197 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.828219 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:46065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260618 23:24:05.828342 26228 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.188:46065: Network error: Client connection negotiation failed: client connection to 127.3.217.188:46065: connect: Connection refused (error 111)
I20260618 23:24:05.852952 26303 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } attempt: 1
I20260618 23:24:05.853430 26305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.853301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:46065 (local address 127.0.0.1:39152)
0618 23:24:05.853363 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.853404 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:46065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260618 23:24:05.853798 26305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.853672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:46065 (local address 127.0.0.1:39168)
0618 23:24:05.853720 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.853780 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:46065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260618 23:24:05.853981 26303 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.188:46065: Network error: Client connection negotiation failed: client connection to 127.3.217.188:46065: connect: Connection refused (error 111)
I20260618 23:24:05.859498 26228 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } attempt: 1
I20260618 23:24:05.860200 26230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.859812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:46065 (local address 127.0.0.1:39178)
0618 23:24:05.860107 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.860174 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:46065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184}
I20260618 23:24:05.860559 26230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.860459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:46065 (local address 127.0.0.1:39194)
0618 23:24:05.860511 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.860535 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:46065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260618 23:24:05.860687 26228 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.188:46065: Network error: Client connection negotiation failed: client connection to 127.3.217.188:46065: connect: Connection refused (error 111)
W20260618 23:24:05.898698 26310 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260618 23:24:05.898952 26310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:24:05.898979 26310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:24:05.899022 26310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:24:05.900111 26310 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:24:05.900184 26310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:24:05.900210 26310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:24:05.900238 26310 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:24:05.900275 26310 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:24:05.901731 26310 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:43995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:38015,127.3.217.189:36729,127.3.217.188:46065
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.188.keytab
--principal=kudu/127.3.217.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.188:46065
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.3.217.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:24:05.902004 26310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:24:05.902228 26310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:24:05.907039 26318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:24:05.907172 26315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:24:05.907197 26316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:24:05.907670 26310 server_base.cc:1034] running on GCE node
I20260618 23:24:05.907914 26310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:24:05.908201 26310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:24:05.909353 26310 hybrid_clock.cc:648] HybridClock initialized: now 1781825045909329 us; error 41 us; skew 500 ppm
Jun 18 23:24:05 dist-test-slave-r9ct krb5kdc[26147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825045, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:24:05.912040 26310 init.cc:377] Logged in from keytab as kudu/127.3.217.188@KRBTEST.COM (short username kudu)
I20260618 23:24:05.912508 26310 webserver.cc:460] Webserver started at http://127.3.217.188:33877/ using document root <none> and password file <none>
I20260618 23:24:05.912721 26310 fs_manager.cc:359] Metadata directory not provided
I20260618 23:24:05.912783 26310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:24:05.912912 26310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:24:05.913939 26310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-2/data/instance:
uuid: "a6eb6a005a63492ea7017dacf65173db"
format_stamp: "Formatted at 2026-06-18 23:24:05 on dist-test-slave-r9ct"
server_key: "fd22d1bc94f540af8b8e96c7aa6469c7"
server_key_iv: "08c3b05e0b762d412d1472f6c5c192ed"
server_key_version: "encryptionkey@0"
I20260618 23:24:05.914279 26310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-2/wal/instance:
uuid: "a6eb6a005a63492ea7017dacf65173db"
format_stamp: "Formatted at 2026-06-18 23:24:05 on dist-test-slave-r9ct"
server_key: "fd22d1bc94f540af8b8e96c7aa6469c7"
server_key_iv: "08c3b05e0b762d412d1472f6c5c192ed"
server_key_version: "encryptionkey@0"
I20260618 23:24:05.915722 26310 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260618 23:24:05.916636 26325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:24:05.916911 26310 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:24:05.916988 26310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-2/wal
uuid: "a6eb6a005a63492ea7017dacf65173db"
format_stamp: "Formatted at 2026-06-18 23:24:05 on dist-test-slave-r9ct"
server_key: "fd22d1bc94f540af8b8e96c7aa6469c7"
server_key_iv: "08c3b05e0b762d412d1472f6c5c192ed"
server_key_version: "encryptionkey@0"
I20260618 23:24:05.917084 26310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:24:05.922132 26303 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } attempt: 2
I20260618 23:24:05.922575 26305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.922446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:46065 (local address 127.0.0.1:39196)
0618 23:24:05.922509 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.922548 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:46065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260618 23:24:05.922991 26305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.922886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:46065 (local address 127.0.0.1:39198)
0618 23:24:05.922937 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.922972 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:46065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260618 23:24:05.923082 26303 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.188:46065: Network error: Client connection negotiation failed: client connection to 127.3.217.188:46065: connect: Connection refused (error 111)
I20260618 23:24:05.935858 26228 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } attempt: 2
I20260618 23:24:05.936317 26230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.936181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:46065 (local address 127.0.0.1:39200)
0618 23:24:05.936245 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.936282 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:46065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260618 23:24:05.936666 26230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.936563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:46065 (local address 127.0.0.1:39214)
0618 23:24:05.936617 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.936643 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:46065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260618 23:24:05.936762 26228 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.188:46065: Network error: Client connection negotiation failed: client connection to 127.3.217.188:46065: connect: Connection refused (error 111)
I20260618 23:24:05.937846 26310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:24:05.940269 26310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:24:05.940384 26310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:24:05.944886 26310 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.188:46065
I20260618 23:24:05.944934 26377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.188:46065 every 8 connection(s)
I20260618 23:24:05.945266 26310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-2/data/info.pb
I20260618 23:24:05.946425 26378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:24:05.948005 26378 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38015 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:24:05.949141 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 26310
I20260618 23:24:05.949226 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781824769284800-3942-0/minicluster-data/master-2/wal/instance
I20260618 23:24:05.949498 3942 external_mini_cluster.cc:1428] Setting key d708fb96bedf6a85a1a4bced804e43ed
Jun 18 23:24:05 dist-test-slave-r9ct krb5kdc[26147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825045, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.188@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
Jun 18 23:24:05 dist-test-slave-r9ct krb5kdc[26147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.188@KRBTEST.COM
I20260618 23:24:05.958510 26231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.948755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35662 (local address 127.3.217.190:38015)
0618 23:24:05.948841 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:05.948844 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:05.949034 (+ 190us) server_negotiation.cc:407] Connection header received
0618 23:24:05.949574 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:05.949576 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:05.949589 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:05.949668 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:05.950484 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.951253 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.952623 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.952897 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.952979 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:05.955389 (+ 2410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:05.955391 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:05.955391 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:05.955399 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:05.957055 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:05.957523 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:05.957525 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:05.957525 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:05.957585 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:05.957863 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:05.957864 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:05.957864 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:05.957978 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:05.958055 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:05.958332 (+ 277us) server_negotiation.cc:299] Negotiation successful
0618 23:24:05.958414 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260618 23:24:05.958765 26380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.948704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:38015 (local address 127.0.0.1:35662)
0618 23:24:05.948860 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.948920 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0618 23:24:05.949469 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:24:05.949755 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:24:05.949759 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:24:05.950152 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:24:05.950414 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:05.950419 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.951361 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.951362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:05.952480 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:05.952483 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.953044 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.953046 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:05.953158 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:05.953752 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:24:05.953762 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:24:05.955268 (+ 1506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:24:05.957149 (+ 1881us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:05.957155 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:05.957157 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:05.957409 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:05.957653 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:05.957654 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:05.957654 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:05.957775 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:05.958047 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:24:05.958053 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:24:05.958181 (+ 128us) client_negotiation.cc:769] Sending connection context
0618 23:24:05.958306 (+ 125us) client_negotiation.cc:240] Negotiation successful
0618 23:24:05.958477 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":22,"thread_start_us":88,"threads_started":1}
I20260618 23:24:05.959270 26378 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:24:05.960930 26382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.949895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39228 (local address 127.3.217.188:46065)
0618 23:24:05.950086 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:05.950093 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:05.950217 (+ 124us) server_negotiation.cc:407] Connection header received
0618 23:24:05.950242 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:05.950245 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:05.950288 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:05.950385 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:05.951209 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.952528 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.953431 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.953919 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.954003 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:05.957354 (+ 3351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:05.957362 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:05.957362 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:05.957369 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:05.959342 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:05.960025 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:05.960028 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:05.960028 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:05.960100 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:05.960332 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:05.960333 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:05.960333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:05.960513 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:05.960622 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:05.960806 (+ 184us) server_negotiation.cc:299] Negotiation successful
0618 23:24:05.960865 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":165,"thread_start_us":113,"threads_started":1}
Jun 18 23:24:05 dist-test-slave-r9ct krb5kdc[26147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825045, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.188@KRBTEST.COM for kudu/127.3.217.189@KRBTEST.COM
Jun 18 23:24:05 dist-test-slave-r9ct krb5kdc[26147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:24:05.968793 26380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.959534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:36729 (local address 127.0.0.1:55638)
0618 23:24:05.959584 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.959594 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:24:05.959645 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:24:05.960049 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:24:05.960049 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:24:05.960330 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:24:05.960390 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:05.960391 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.961410 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.961411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:05.962048 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:05.962050 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.963322 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.963323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:05.963379 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:05.963835 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:24:05.963843 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:24:05.965286 (+ 1443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:24:05.967612 (+ 2326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:05.967614 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:05.967615 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:05.967821 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:05.968051 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:05.968052 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:05.968052 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:05.968124 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:05.968444 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:24:05.968445 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:24:05.968522 (+ 77us) client_negotiation.cc:769] Sending connection context
0618 23:24:05.968608 (+ 86us) client_negotiation.cc:240] Negotiation successful
0618 23:24:05.968716 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260618 23:24:05.968883 26307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.959801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55638 (local address 127.3.217.189:36729)
0618 23:24:05.959849 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:05.959851 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:05.959859 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:24:05.959891 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:05.959892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:05.959907 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:05.960047 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:05.960497 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.961318 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.962127 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.962515 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.962603 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:05.965447 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:05.965448 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:05.965449 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:05.965458 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:05.967499 (+ 2041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:05.967898 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:05.967899 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:05.967900 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:05.967960 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:05.968197 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:05.968198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:05.968198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:05.968350 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:05.968434 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:05.968667 (+ 233us) server_negotiation.cc:299] Negotiation successful
0618 23:24:05.968759 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260618 23:24:05.969240 26378 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:24:05.970715 26231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.961782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35664 (local address 127.3.217.190:38015)
0618 23:24:05.961825 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:05.961827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:05.961836 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:24:05.961902 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:05.961903 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:05.961914 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:05.961974 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:05.962642 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.963181 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.964138 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.964371 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.964464 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:05.967682 (+ 3218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:05.967683 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:05.967684 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:05.967690 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:05.969469 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:05.969855 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:05.969856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:05.969857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:05.969926 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:05.970160 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:05.970162 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:05.970162 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:05.970293 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:05.970493 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:05.970533 (+ 40us) server_negotiation.cc:299] Negotiation successful
0618 23:24:05.970609 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
Jun 18 23:24:05 dist-test-slave-r9ct krb5kdc[26147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825045, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.188@KRBTEST.COM for kudu/127.3.217.188@KRBTEST.COM
Jun 18 23:24:05 dist-test-slave-r9ct krb5kdc[26147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.189@KRBTEST.COM
I20260618 23:24:05.976672 26380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.969514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:46065 (local address 127.0.0.1:39238)
0618 23:24:05.969545 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:05.969555 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:24:05.969591 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:24:05.969752 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:24:05.969753 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:24:05.969878 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:24:05.969905 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:05.969906 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.970601 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.970602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:05.971350 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:05.971352 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.971821 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.971822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:05.971889 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:05.972329 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:24:05.972334 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:24:05.973516 (+ 1182us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:24:05.975438 (+ 1922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:05.975439 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:05.975439 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:05.975595 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:05.975903 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:05.975904 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:05.975905 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:05.975968 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:05.976297 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:24:05.976297 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:24:05.976361 (+ 64us) client_negotiation.cc:769] Sending connection context
0618 23:24:05.976437 (+ 76us) client_negotiation.cc:240] Negotiation successful
0618 23:24:05.976528 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
I20260618 23:24:05.976780 26382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.969547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39238 (local address 127.3.217.188:46065)
0618 23:24:05.969652 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:05.969653 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:05.969657 (+ 4us) server_negotiation.cc:407] Connection header received
0618 23:24:05.969669 (+ 12us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:05.969670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:05.969675 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:05.969747 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:05.969977 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.970508 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.971444 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.971743 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.971807 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:05.973576 (+ 1769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:05.973578 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:05.973578 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:05.973593 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:05.975317 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:05.975669 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:05.975670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:05.975671 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:05.975728 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:05.976045 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:05.976046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:05.976047 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:05.976196 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:05.976301 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:05.976503 (+ 202us) server_negotiation.cc:299] Negotiation successful
0618 23:24:05.976599 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260618 23:24:05.978158 26378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6eb6a005a63492ea7017dacf65173db: Bootstrap starting.
I20260618 23:24:05.979084 26378 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6eb6a005a63492ea7017dacf65173db: Neither blocks nor log segments found. Creating new log.
I20260618 23:24:05.979408 26307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:05.971349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55642 (local address 127.3.217.189:36729)
0618 23:24:05.971380 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:05.971382 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:05.971420 (+ 38us) server_negotiation.cc:407] Connection header received
0618 23:24:05.971490 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:05.971491 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:05.971501 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:05.971551 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:05.972106 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.972670 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.973499 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:05.973837 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:05.973904 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:05.976379 (+ 2475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:05.976380 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:05.976381 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:05.976388 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:05.978123 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:05.978544 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:05.978545 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:05.978546 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:05.978602 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:05.978871 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:05.978872 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:05.978872 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:05.978991 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:05.979147 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:05.979218 (+ 71us) server_negotiation.cc:299] Negotiation successful
0618 23:24:05.979304 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260618 23:24:05.979429 26378 log.cc:824] T 00000000000000000000000000000000 P a6eb6a005a63492ea7017dacf65173db: Log is configured to *not* fsync() on all Append() calls
I20260618 23:24:05.980319 26378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6eb6a005a63492ea7017dacf65173db: No bootstrap required, opened a new log
I20260618 23:24:05.981007 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:24:05.982079 26378 raft_consensus.cc:348] T 00000000000000000000000000000000 P a6eb6a005a63492ea7017dacf65173db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503c2ba5566246bc8b15553d4da3dfc8" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38015 } } peers { permanent_uuid: "2b85d2474f344800985d6320b6904ec8" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } } peers { permanent_uuid: "a6eb6a005a63492ea7017dacf65173db" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } }
I20260618 23:24:05.982206 26378 raft_consensus.cc:729] T 00000000000000000000000000000000 P a6eb6a005a63492ea7017dacf65173db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6eb6a005a63492ea7017dacf65173db, State: Initialized, Role: FOLLOWER
I20260618 23:24:05.982463 26378 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6eb6a005a63492ea7017dacf65173db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503c2ba5566246bc8b15553d4da3dfc8" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38015 } } peers { permanent_uuid: "2b85d2474f344800985d6320b6904ec8" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } } peers { permanent_uuid: "a6eb6a005a63492ea7017dacf65173db" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } }
I20260618 23:24:05.983006 26378 sys_catalog.cc:564] T 00000000000000000000000000000000 P a6eb6a005a63492ea7017dacf65173db [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:24:05.983006 26384 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6eb6a005a63492ea7017dacf65173db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503c2ba5566246bc8b15553d4da3dfc8" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38015 } } peers { permanent_uuid: "2b85d2474f344800985d6320b6904ec8" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } } peers { permanent_uuid: "a6eb6a005a63492ea7017dacf65173db" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } } }
I20260618 23:24:05.983136 26384 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6eb6a005a63492ea7017dacf65173db [sys.catalog]: This master's current role is: FOLLOWER
I20260618 23:24:05.982101 26202 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "503c2ba5566246bc8b15553d4da3dfc8"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35664
W20260618 23:24:05.984733 26395 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a6eb6a005a63492ea7017dacf65173db: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260618 23:24:05.984789 26395 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260618 23:24:05.985086 26310 master_runner.cc:186] Error getting master registration for 127.3.217.190:38015: OK, instance_id { permanent_uuid: "503c2ba5566246bc8b15553d4da3dfc8" instance_seqno: 1781825045593885 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260618 23:24:05.987511 26310 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260618 23:24:06.014221 26303 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } attempt: 3
Jun 18 23:24:06 dist-test-slave-r9ct krb5kdc[26147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825045, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.189@KRBTEST.COM for kudu/127.3.217.188@KRBTEST.COM
I20260618 23:24:06.023749 26382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:06.014674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39252 (local address 127.3.217.188:46065)
0618 23:24:06.014765 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:06.014766 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:06.014781 (+ 15us) server_negotiation.cc:407] Connection header received
0618 23:24:06.014810 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:06.014811 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:06.014820 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:06.014886 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:06.015361 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:06.016205 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:06.017730 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:06.018103 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:06.018194 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:06.020727 (+ 2533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:06.020729 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:06.020729 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:06.020737 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:06.022432 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:06.022855 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:06.022857 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:06.022857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:06.022923 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:06.023145 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:06.023146 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:06.023146 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:06.023367 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:06.023446 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:06.023582 (+ 136us) server_negotiation.cc:299] Negotiation successful
0618 23:24:06.023656 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260618 23:24:06.023759 26305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:06.014599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:46065 (local address 127.0.0.1:39252)
0618 23:24:06.014659 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:06.014671 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:24:06.014758 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:24:06.014891 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:24:06.014892 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:24:06.015085 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:24:06.015140 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:06.015142 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:06.016348 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:06.016350 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:06.017612 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:06.017616 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:06.018201 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:06.018202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:06.018265 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:06.018952 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:24:06.018958 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:24:06.020562 (+ 1604us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:24:06.022522 (+ 1960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:06.022523 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:06.022524 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:06.022774 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:06.023010 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:06.023011 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:06.023011 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:06.023073 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:06.023438 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:24:06.023439 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:24:06.023486 (+ 47us) client_negotiation.cc:769] Sending connection context
0618 23:24:06.023545 (+ 59us) client_negotiation.cc:240] Negotiation successful
0618 23:24:06.023652 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260618 23:24:06.025614 26303 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b85d2474f344800985d6320b6904ec8: Bootstrap starting.
I20260618 23:24:06.026540 26303 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b85d2474f344800985d6320b6904ec8: Neither blocks nor log segments found. Creating new log.
I20260618 23:24:06.026885 26303 log.cc:824] T 00000000000000000000000000000000 P 2b85d2474f344800985d6320b6904ec8: Log is configured to *not* fsync() on all Append() calls
I20260618 23:24:06.027828 26303 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b85d2474f344800985d6320b6904ec8: No bootstrap required, opened a new log
I20260618 23:24:06.029873 26303 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b85d2474f344800985d6320b6904ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503c2ba5566246bc8b15553d4da3dfc8" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38015 } } peers { permanent_uuid: "2b85d2474f344800985d6320b6904ec8" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } } peers { permanent_uuid: "a6eb6a005a63492ea7017dacf65173db" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } }
I20260618 23:24:06.030019 26303 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b85d2474f344800985d6320b6904ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b85d2474f344800985d6320b6904ec8, State: Initialized, Role: FOLLOWER
I20260618 23:24:06.030107 26303 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b85d2474f344800985d6320b6904ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503c2ba5566246bc8b15553d4da3dfc8" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38015 } } peers { permanent_uuid: "2b85d2474f344800985d6320b6904ec8" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } } peers { permanent_uuid: "a6eb6a005a63492ea7017dacf65173db" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } }
I20260618 23:24:06.030434 26303 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b85d2474f344800985d6320b6904ec8 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:24:06.030401 26398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b85d2474f344800985d6320b6904ec8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503c2ba5566246bc8b15553d4da3dfc8" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38015 } } peers { permanent_uuid: "2b85d2474f344800985d6320b6904ec8" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } } peers { permanent_uuid: "a6eb6a005a63492ea7017dacf65173db" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } } }
I20260618 23:24:06.030509 26398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b85d2474f344800985d6320b6904ec8 [sys.catalog]: This master's current role is: FOLLOWER
W20260618 23:24:06.032343 26409 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2b85d2474f344800985d6320b6904ec8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260618 23:24:06.032402 26409 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260618 23:24:06.035884 26228 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } attempt: 3
I20260618 23:24:06.032670 26235 master_runner.cc:186] Error getting master registration for 127.3.217.190:38015: OK, instance_id { permanent_uuid: "503c2ba5566246bc8b15553d4da3dfc8" instance_seqno: 1781825045593885 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260618 23:24:06.036164 26235 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Jun 18 23:24:06 dist-test-slave-r9ct krb5kdc[26147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825045, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for kudu/127.3.217.188@KRBTEST.COM
I20260618 23:24:06.044466 26230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:06.036168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:46065 (local address 127.0.0.1:39256)
0618 23:24:06.036271 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:06.036282 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:24:06.036322 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:24:06.036683 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:24:06.036686 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:24:06.036898 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:24:06.036955 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:06.036958 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:06.038055 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:06.038057 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:06.038574 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:06.038576 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:06.039077 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:06.039078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:06.039147 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:06.039656 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:24:06.039662 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:24:06.041087 (+ 1425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:24:06.043383 (+ 2296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:06.043385 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:06.043385 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:06.043605 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:06.043803 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:06.043804 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:06.043804 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:06.043874 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:06.044127 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:24:06.044129 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:24:06.044176 (+ 47us) client_negotiation.cc:769] Sending connection context
0618 23:24:06.044243 (+ 67us) client_negotiation.cc:240] Negotiation successful
0618 23:24:06.044353 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260618 23:24:06.045078 26382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:06.036396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39256 (local address 127.3.217.188:46065)
0618 23:24:06.036488 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:06.036491 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:06.036508 (+ 17us) server_negotiation.cc:407] Connection header received
0618 23:24:06.036542 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:06.036544 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:06.036559 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:06.036664 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:06.037222 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:06.037975 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:06.038681 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:06.038993 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:06.039063 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:06.041163 (+ 2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:06.041165 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:06.041165 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:06.041179 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:06.043247 (+ 2068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:06.043674 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:06.043675 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:06.043675 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:06.043743 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:06.043937 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:06.043938 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:06.043938 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:06.044052 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:06.044134 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:06.044899 (+ 765us) server_negotiation.cc:299] Negotiation successful
0618 23:24:06.044983 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260618 23:24:06.047662 26228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8: Bootstrap starting.
I20260618 23:24:06.048342 26228 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8: Neither blocks nor log segments found. Creating new log.
I20260618 23:24:06.048684 26228 log.cc:824] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8: Log is configured to *not* fsync() on all Append() calls
I20260618 23:24:06.049543 26228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8: No bootstrap required, opened a new log
I20260618 23:24:06.051273 26228 raft_consensus.cc:348] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503c2ba5566246bc8b15553d4da3dfc8" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38015 } } peers { permanent_uuid: "2b85d2474f344800985d6320b6904ec8" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } } peers { permanent_uuid: "a6eb6a005a63492ea7017dacf65173db" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } }
I20260618 23:24:06.051421 26228 raft_consensus.cc:729] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503c2ba5566246bc8b15553d4da3dfc8, State: Initialized, Role: FOLLOWER
I20260618 23:24:06.051504 26228 consensus_queue.cc:260] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503c2ba5566246bc8b15553d4da3dfc8" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38015 } } peers { permanent_uuid: "2b85d2474f344800985d6320b6904ec8" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } } peers { permanent_uuid: "a6eb6a005a63492ea7017dacf65173db" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } }
I20260618 23:24:06.051839 26228 sys_catalog.cc:564] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:24:06.051858 26202 raft_consensus.cc:482] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260618 23:24:06.051903 26202 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:24:06.052802 26202 raft_consensus.cc:504] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503c2ba5566246bc8b15553d4da3dfc8" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38015 } } peers { permanent_uuid: "2b85d2474f344800985d6320b6904ec8" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } } peers { permanent_uuid: "a6eb6a005a63492ea7017dacf65173db" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } }
I20260618 23:24:06.053071 26202 leader_election.cc:288] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8 [CANDIDATE]: Term 1 election: Requested vote from peers 2b85d2474f344800985d6320b6904ec8 (127.3.217.189:36729), a6eb6a005a63492ea7017dacf65173db (127.3.217.188:46065)
I20260618 23:24:06.051802 26412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503c2ba5566246bc8b15553d4da3dfc8" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38015 } } peers { permanent_uuid: "2b85d2474f344800985d6320b6904ec8" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } } peers { permanent_uuid: "a6eb6a005a63492ea7017dacf65173db" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } } }
I20260618 23:24:06.053399 26412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8 [sys.catalog]: This master's current role is: FOLLOWER
I20260618 23:24:06.053504 26277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "503c2ba5566246bc8b15553d4da3dfc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2b85d2474f344800985d6320b6904ec8"
I20260618 23:24:06.053659 26277 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b85d2474f344800985d6320b6904ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:24:06.054365 26277 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2b85d2474f344800985d6320b6904ec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503c2ba5566246bc8b15553d4da3dfc8 in term 1.
I20260618 23:24:06.055454 26352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "503c2ba5566246bc8b15553d4da3dfc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a6eb6a005a63492ea7017dacf65173db"
I20260618 23:24:06.055619 26352 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a6eb6a005a63492ea7017dacf65173db [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:24:06.056639 26352 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a6eb6a005a63492ea7017dacf65173db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503c2ba5566246bc8b15553d4da3dfc8 in term 1.
I20260618 23:24:06.057027 26177 leader_election.cc:302] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503c2ba5566246bc8b15553d4da3dfc8, a6eb6a005a63492ea7017dacf65173db; no voters:
I20260618 23:24:06.057179 26412 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:24:06.057313 26412 raft_consensus.cc:686] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8 [term 1 LEADER]: Becoming Leader. State: Replica: 503c2ba5566246bc8b15553d4da3dfc8, State: Running, Role: LEADER
I20260618 23:24:06.057404 26412 consensus_queue.cc:237] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503c2ba5566246bc8b15553d4da3dfc8" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38015 } } peers { permanent_uuid: "2b85d2474f344800985d6320b6904ec8" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } } peers { permanent_uuid: "a6eb6a005a63492ea7017dacf65173db" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } }
I20260618 23:24:06.057801 26412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 503c2ba5566246bc8b15553d4da3dfc8. Latest consensus state: current_term: 1 leader_uuid: "503c2ba5566246bc8b15553d4da3dfc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503c2ba5566246bc8b15553d4da3dfc8" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38015 } } peers { permanent_uuid: "2b85d2474f344800985d6320b6904ec8" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } } peers { permanent_uuid: "a6eb6a005a63492ea7017dacf65173db" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } } }
I20260618 23:24:06.057873 26412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8 [sys.catalog]: This master's current role is: LEADER
W20260618 23:24:06.059257 26424 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260618 23:24:06.059288 26160 master_runner.cc:263] No leader master found from master 503c2ba5566246bc8b15553d4da3dfc8
W20260618 23:24:06.059350 26424 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260618 23:24:06.059372 26160 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260618 23:24:06.063208 26430 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:24:06.063938 26430 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:24:06.065506 26352 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a6eb6a005a63492ea7017dacf65173db [term 1 FOLLOWER]: Refusing update from remote peer 503c2ba5566246bc8b15553d4da3dfc8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:24:06.065791 26277 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2b85d2474f344800985d6320b6904ec8 [term 1 FOLLOWER]: Refusing update from remote peer 503c2ba5566246bc8b15553d4da3dfc8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:24:06.066026 26412 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6eb6a005a63492ea7017dacf65173db" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:24:06.066236 26412 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b85d2474f344800985d6320b6904ec8" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:24:06.068022 26384 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6eb6a005a63492ea7017dacf65173db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 503c2ba5566246bc8b15553d4da3dfc8. Latest consensus state: current_term: 1 leader_uuid: "503c2ba5566246bc8b15553d4da3dfc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503c2ba5566246bc8b15553d4da3dfc8" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38015 } } peers { permanent_uuid: "2b85d2474f344800985d6320b6904ec8" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } } peers { permanent_uuid: "a6eb6a005a63492ea7017dacf65173db" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } } }
I20260618 23:24:06.068125 26384 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6eb6a005a63492ea7017dacf65173db [sys.catalog]: This master's current role is: FOLLOWER
I20260618 23:24:06.068805 26398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b85d2474f344800985d6320b6904ec8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 503c2ba5566246bc8b15553d4da3dfc8. Latest consensus state: current_term: 1 leader_uuid: "503c2ba5566246bc8b15553d4da3dfc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503c2ba5566246bc8b15553d4da3dfc8" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38015 } } peers { permanent_uuid: "2b85d2474f344800985d6320b6904ec8" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } } peers { permanent_uuid: "a6eb6a005a63492ea7017dacf65173db" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } } }
I20260618 23:24:06.068928 26398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b85d2474f344800985d6320b6904ec8 [sys.catalog]: This master's current role is: FOLLOWER
I20260618 23:24:06.071996 26412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "503c2ba5566246bc8b15553d4da3dfc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503c2ba5566246bc8b15553d4da3dfc8" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38015 } } peers { permanent_uuid: "2b85d2474f344800985d6320b6904ec8" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } } peers { permanent_uuid: "a6eb6a005a63492ea7017dacf65173db" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } } }
I20260618 23:24:06.072099 26412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8 [sys.catalog]: This master's current role is: LEADER
I20260618 23:24:06.072575 26384 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6eb6a005a63492ea7017dacf65173db [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "503c2ba5566246bc8b15553d4da3dfc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503c2ba5566246bc8b15553d4da3dfc8" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38015 } } peers { permanent_uuid: "2b85d2474f344800985d6320b6904ec8" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } } peers { permanent_uuid: "a6eb6a005a63492ea7017dacf65173db" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } } }
I20260618 23:24:06.072662 26384 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6eb6a005a63492ea7017dacf65173db [sys.catalog]: This master's current role is: FOLLOWER
I20260618 23:24:06.072903 26435 mvcc.cc:205] Tried to move back new op lower bound from 7298355388681703424 to 7298355388651773952. Current Snapshot: MvccSnapshot[applied={T|T < 7298355388681703424}]
I20260618 23:24:06.073050 26436 mvcc.cc:205] Tried to move back new op lower bound from 7298355388681703424 to 7298355388651773952. Current Snapshot: MvccSnapshot[applied={T|T < 7298355388681703424}]
I20260618 23:24:06.076064 26412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "503c2ba5566246bc8b15553d4da3dfc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503c2ba5566246bc8b15553d4da3dfc8" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38015 } } peers { permanent_uuid: "2b85d2474f344800985d6320b6904ec8" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } } peers { permanent_uuid: "a6eb6a005a63492ea7017dacf65173db" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } } }
I20260618 23:24:06.076170 26412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8 [sys.catalog]: This master's current role is: LEADER
I20260618 23:24:06.076699 26398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b85d2474f344800985d6320b6904ec8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "503c2ba5566246bc8b15553d4da3dfc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503c2ba5566246bc8b15553d4da3dfc8" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 38015 } } peers { permanent_uuid: "2b85d2474f344800985d6320b6904ec8" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 36729 } } peers { permanent_uuid: "a6eb6a005a63492ea7017dacf65173db" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 46065 } } }
I20260618 23:24:06.076825 26398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b85d2474f344800985d6320b6904ec8 [sys.catalog]: This master's current role is: FOLLOWER
I20260618 23:24:06.077445 26438 mvcc.cc:205] Tried to move back new op lower bound from 7298355388681703424 to 7298355388651773952. Current Snapshot: MvccSnapshot[applied={T|T < 7298355388681703424}]
I20260618 23:24:06.078760 26430 catalog_manager.cc:1347] Generated new cluster ID: 6bbe61410d6a4d889eba3e10bbd5a35c
I20260618 23:24:06.078822 26430 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:24:06.081822 26307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:06.059688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55646 (local address 127.3.217.189:36729)
0618 23:24:06.059741 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:06.059743 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:06.064757 (+ 5014us) server_negotiation.cc:407] Connection header received
0618 23:24:06.064864 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:06.064865 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:06.064877 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:06.064907 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:06.069794 (+ 4887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:06.070657 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:06.071818 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:06.072132 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:06.072199 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:06.074147 (+ 1948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:06.074148 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:06.074149 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:06.074156 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:06.076328 (+ 2172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:06.078222 (+ 1894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:06.078224 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:06.078224 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:06.078292 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:06.078536 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:06.078538 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:06.078538 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:06.078683 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:06.078815 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:06.081654 (+ 2839us) server_negotiation.cc:299] Negotiation successful
0618 23:24:06.081733 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260618 23:24:06.083475 26382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:06.059905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39266 (local address 127.3.217.188:46065)
0618 23:24:06.059945 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:06.059947 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:06.065035 (+ 5088us) server_negotiation.cc:407] Connection header received
0618 23:24:06.069900 (+ 4865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:06.069901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:06.069913 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:06.069944 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:06.070694 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:06.071514 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:06.074345 (+ 2831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:06.074686 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:06.074761 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:06.079249 (+ 4488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:06.079251 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:06.079251 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:06.079258 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:06.081052 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:06.082616 (+ 1564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:06.082617 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:06.082617 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:06.082678 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:06.082890 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:06.082890 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:06.082891 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:06.083004 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:06.083066 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:06.083314 (+ 248us) server_negotiation.cc:299] Negotiation successful
0618 23:24:06.083385 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260618 23:24:06.090762 26430 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:24:06.091593 26430 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:24:06.095963 26231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:06.062972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35668 (local address 127.3.217.190:38015)
0618 23:24:06.063015 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:06.063018 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:06.078862 (+ 15844us) server_negotiation.cc:407] Connection header received
0618 23:24:06.078960 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:06.078961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:06.078971 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:06.078999 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:06.079631 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:06.080352 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:06.086810 (+ 6458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:06.087148 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:06.087227 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:06.092525 (+ 5298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:06.092526 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:06.092527 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:06.092534 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:06.094274 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:06.094674 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:06.094675 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:06.094675 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:06.094960 (+ 285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:06.095195 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:06.095196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:06.095197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:06.095425 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:06.095538 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:06.095767 (+ 229us) server_negotiation.cc:299] Negotiation successful
0618 23:24:06.095867 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260618 23:24:06.101243 26430 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 503c2ba5566246bc8b15553d4da3dfc8: Generated new TSK 0
I20260618 23:24:06.101519 26430 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260618 23:24:06.130203 26307 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:06.128618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55658 (local address 127.3.217.189:36729)
0618 23:24:06.128668 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:06.128671 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:06.129359 (+ 688us) server_negotiation.cc:407] Connection header received
0618 23:24:06.129487 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:06.129489 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:06.129502 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:06.129538 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:06.130099 (+ 561us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55658: BlockingRecv error: recv got EOF from 127.0.0.1:55658 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260618 23:24:06.131464 26382 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:06.129041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39282 (local address 127.3.217.188:46065)
0618 23:24:06.129086 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:06.129089 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:06.130860 (+ 1771us) server_negotiation.cc:407] Connection header received
0618 23:24:06.130972 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:06.130973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:06.130985 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:06.131018 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:06.131390 (+ 372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39282: BlockingRecv error: recv got EOF from 127.0.0.1:39282 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260618 23:24:06.133134 26231 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:06.132180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35680 (local address 127.3.217.190:38015)
0618 23:24:06.132350 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:06.132353 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:06.132562 (+ 209us) server_negotiation.cc:407] Connection header received
0618 23:24:06.132659 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:06.132661 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:06.132671 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:06.132701 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:06.133071 (+ 370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35680: BlockingRecv error: recv got EOF from 127.0.0.1:35680 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260618 23:24:06.148094 26307 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:06.143096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55662 (local address 127.3.217.189:36729)
0618 23:24:06.143143 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:06.143145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:06.146897 (+ 3752us) server_negotiation.cc:407] Connection header received
0618 23:24:06.147023 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:06.147024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:06.147046 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:06.147077 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:06.148030 (+ 953us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55662: BlockingRecv error: recv got EOF from 127.0.0.1:55662 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260618 23:24:06.151391 26307 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:06.150560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55668 (local address 127.3.217.189:36729)
0618 23:24:06.150597 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:06.150599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:06.150926 (+ 327us) server_negotiation.cc:407] Connection header received
0618 23:24:06.150959 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:06.150960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:06.150974 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:06.151027 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:06.151337 (+ 310us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55668: BlockingRecv error: recv got EOF from 127.0.0.1:55668 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260618 23:24:06.155289 26307 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:06.154618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55684 (local address 127.3.217.189:36729)
0618 23:24:06.154655 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:06.154657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:06.154780 (+ 123us) server_negotiation.cc:407] Connection header received
0618 23:24:06.154888 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:06.154889 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:06.154900 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:06.154929 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:06.155240 (+ 311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55684: BlockingRecv error: recv got EOF from 127.0.0.1:55684 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260618 23:24:06.165422 26307 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:06.164452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55696 (local address 127.3.217.189:36729)
0618 23:24:06.164494 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:06.164496 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:06.164791 (+ 295us) server_negotiation.cc:407] Connection header received
0618 23:24:06.164899 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:06.164901 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:06.164913 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:06.164944 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:06.165362 (+ 418us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55696: BlockingRecv error: recv got EOF from 127.0.0.1:55696 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260618 23:24:06.175974 26307 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:06.174947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55698 (local address 127.3.217.189:36729)
0618 23:24:06.175013 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:06.175015 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:06.175326 (+ 311us) server_negotiation.cc:407] Connection header received
0618 23:24:06.175438 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:06.175440 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:06.175452 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:06.175485 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:06.175912 (+ 427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55698: BlockingRecv error: recv got EOF from 127.0.0.1:55698 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260618 23:24:06.195565 26307 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:06.193375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55712 (local address 127.3.217.189:36729)
0618 23:24:06.193418 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:06.193421 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:06.194937 (+ 1516us) server_negotiation.cc:407] Connection header received
0618 23:24:06.195054 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:06.195055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:06.195067 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:06.195099 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:06.195503 (+ 404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55712: BlockingRecv error: recv got EOF from 127.0.0.1:55712 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260618 23:24:06.229872 26307 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:06.228922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55728 (local address 127.3.217.189:36729)
0618 23:24:06.228970 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:06.228972 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:06.229238 (+ 266us) server_negotiation.cc:407] Connection header received
0618 23:24:06.229352 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:06.229353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:06.229366 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:06.229398 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:06.229814 (+ 416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55728: BlockingRecv error: recv got EOF from 127.0.0.1:55728 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260618 23:24:06.296252 26307 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:06.295386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55742 (local address 127.3.217.189:36729)
0618 23:24:06.295486 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:06.295488 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:06.295500 (+ 12us) server_negotiation.cc:407] Connection header received
0618 23:24:06.295527 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:06.295528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:06.295547 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:06.295618 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:06.296149 (+ 531us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55742: BlockingRecv error: recv got EOF from 127.0.0.1:55742 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260618 23:24:06.426438 26307 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:06.425366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55752 (local address 127.3.217.189:36729)
0618 23:24:06.425548 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:06.425551 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:06.425566 (+ 15us) server_negotiation.cc:407] Connection header received
0618 23:24:06.425605 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:06.425606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:06.425619 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:06.425718 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:06.426385 (+ 667us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55752: BlockingRecv error: recv got EOF from 127.0.0.1:55752 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
W20260618 23:24:06.685194 26307 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:06.684452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55764 (local address 127.3.217.189:36729)
0618 23:24:06.684543 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:06.684545 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:06.684557 (+ 12us) server_negotiation.cc:407] Connection header received
0618 23:24:06.684592 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:06.684594 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:06.684613 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:06.684675 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:06.685113 (+ 438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55764: BlockingRecv error: recv got EOF from 127.0.0.1:55764 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260618 23:24:06.985237 26395 catalog_manager.cc:1259] Loaded cluster ID: 6bbe61410d6a4d889eba3e10bbd5a35c
I20260618 23:24:06.985351 26395 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a6eb6a005a63492ea7017dacf65173db: loading cluster ID for follower catalog manager: success
I20260618 23:24:06.986172 26395 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a6eb6a005a63492ea7017dacf65173db: acquiring CA information for follower catalog manager: success
I20260618 23:24:06.986472 26395 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a6eb6a005a63492ea7017dacf65173db: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260618 23:24:07.032840 26409 catalog_manager.cc:1259] Loaded cluster ID: 6bbe61410d6a4d889eba3e10bbd5a35c
I20260618 23:24:07.032922 26409 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2b85d2474f344800985d6320b6904ec8: loading cluster ID for follower catalog manager: success
I20260618 23:24:07.033689 26409 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2b85d2474f344800985d6320b6904ec8: acquiring CA information for follower catalog manager: success
I20260618 23:24:07.033924 26409 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2b85d2474f344800985d6320b6904ec8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260618 23:24:07.201510 26507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:07.198574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55776 (local address 127.3.217.189:36729)
0618 23:24:07.198738 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:07.198741 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:07.198752 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:24:07.198869 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:07.198870 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:07.198933 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:07.199018 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:24:07.199246 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:07.199787 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:07.200614 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:07.200851 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:07.200937 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:07.201116 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:24:07.201241 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:24:07.201337 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:07.201379 (+ 42us) server_negotiation.cc:299] Negotiation successful
0618 23:24:07.201402 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":59,"threads_started":1}
I20260618 23:24:07.206312 26513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:07.203660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39296 (local address 127.3.217.188:46065)
0618 23:24:07.203866 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:07.203869 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:07.203880 (+ 11us) server_negotiation.cc:407] Connection header received
0618 23:24:07.203929 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:07.203930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:07.203974 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:07.204158 (+ 184us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:24:07.204327 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:07.204798 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:07.205516 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:07.205709 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:07.205765 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:07.205902 (+ 137us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:24:07.205990 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:24:07.206044 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:07.206141 (+ 97us) server_negotiation.cc:299] Negotiation successful
0618 23:24:07.206201 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":105,"threads_started":1}
I20260618 23:24:07.210776 26513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:07.208199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39312 (local address 127.3.217.188:46065)
0618 23:24:07.208241 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:07.208242 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:07.208367 (+ 125us) server_negotiation.cc:407] Connection header received
0618 23:24:07.208415 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:07.208416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:07.208426 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:07.208477 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:24:07.208617 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:07.209303 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:07.210080 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:07.210340 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:07.210399 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:07.210529 (+ 130us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:24:07.210557 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:24:07.210608 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:07.210669 (+ 61us) server_negotiation.cc:299] Negotiation successful
0618 23:24:07.210689 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260618 23:24:07.211059 26507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:07.207947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55778 (local address 127.3.217.189:36729)
0618 23:24:07.208011 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:07.208013 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:07.208136 (+ 123us) server_negotiation.cc:407] Connection header received
0618 23:24:07.208237 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:07.208238 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:07.208254 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:07.208283 (+ 29us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:24:07.208470 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:07.209213 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:07.210298 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:07.210589 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:07.210651 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:07.210830 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:24:07.210863 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:24:07.210919 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:07.210978 (+ 59us) server_negotiation.cc:299] Negotiation successful
0618 23:24:07.211000 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260618 23:24:07.211505 26520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:07.207981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35694 (local address 127.3.217.190:38015)
0618 23:24:07.208239 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:07.208241 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:07.208255 (+ 14us) server_negotiation.cc:407] Connection header received
0618 23:24:07.208298 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:07.208299 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:07.208349 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:07.208432 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:24:07.208647 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:07.209121 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:07.210267 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:07.210581 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:07.210638 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:07.211097 (+ 459us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:24:07.211213 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:24:07.211265 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:07.211386 (+ 121us) server_negotiation.cc:299] Negotiation successful
0618 23:24:07.211415 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":42,"threads_started":1}
I20260618 23:24:07.213027 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 26160
I20260618 23:24:07.218434 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 26235
I20260618 23:24:07.223634 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 26310
2026-06-18T23:24:07Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2945 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 18 23:24:07 dist-test-slave-r9ct krb5kdc[26524](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 18 23:24:07 dist-test-slave-r9ct krb5kdc[26524](info): set up 2 sockets
Jun 18 23:24:07 dist-test-slave-r9ct krb5kdc[26524](info): commencing operation
krb5kdc: starting...
W20260618 23:24:08.319049 3942 mini_kdc.cc:121] Time spent starting KDC: real 1.075s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/test-user.keytab.
Jun 18 23:24:08 dist-test-slave-r9ct krb5kdc[26524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825048, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-18T23:24:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-18T23:24:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.217.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
Entry for principal kudu/127.3.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab.
I20260618 23:24:08.442057 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:42449
--webserver_interface=127.3.217.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:41865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:42449,127.3.217.189:43125,127.3.217.188:33867
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260618 23:24:08.525117 26537 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260618 23:24:08.525391 26537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:24:08.525424 26537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:24:08.525475 26537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:24:08.526697 26537 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:24:08.526809 26537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:24:08.526842 26537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:24:08.526878 26537 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:24:08.526906 26537 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:24:08.528503 26537 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:41865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:42449,127.3.217.189:43125,127.3.217.188:33867
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.190.keytab
--principal=kudu/127.3.217.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.190:42449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.217.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26537
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:24:08.528800 26537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:24:08.529044 26537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:24:08.534500 26542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:24:08.534489 26545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:24:08.534687 26543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:24:08.535050 26537 server_base.cc:1034] running on GCE node
I20260618 23:24:08.535362 26537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:24:08.535663 26537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:24:08.536845 26537 hybrid_clock.cc:648] HybridClock initialized: now 1781825048536873 us; error 105 us; skew 500 ppm
Jun 18 23:24:08 dist-test-slave-r9ct krb5kdc[26524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825048, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:24:08.544771 26537 init.cc:377] Logged in from keytab as kudu/127.3.217.190@KRBTEST.COM (short username kudu)
I20260618 23:24:08.545225 26537 webserver.cc:460] Webserver started at http://127.3.217.190:42887/ using document root <none> and password file <none>
I20260618 23:24:08.545452 26537 fs_manager.cc:359] Metadata directory not provided
I20260618 23:24:08.545521 26537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:24:08.545667 26537 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:24:08.546830 26537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-0/data/instance:
uuid: "cae64a87681348e18c55e05d1660d430"
format_stamp: "Formatted at 2026-06-18 23:24:08 on dist-test-slave-r9ct"
server_key: "c43c2e0b9f0720052bf83e8aed3566f4"
server_key_iv: "99a934f4e327479985939ca7c5a9d8aa"
server_key_version: "encryptionkey@0"
I20260618 23:24:08.547180 26537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-0/wal/instance:
uuid: "cae64a87681348e18c55e05d1660d430"
format_stamp: "Formatted at 2026-06-18 23:24:08 on dist-test-slave-r9ct"
server_key: "c43c2e0b9f0720052bf83e8aed3566f4"
server_key_iv: "99a934f4e327479985939ca7c5a9d8aa"
server_key_version: "encryptionkey@0"
I20260618 23:24:08.548528 26537 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:24:08.549366 26552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:24:08.549707 26537 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 23:24:08.550002 26537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-0/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-0/wal
uuid: "cae64a87681348e18c55e05d1660d430"
format_stamp: "Formatted at 2026-06-18 23:24:08 on dist-test-slave-r9ct"
server_key: "c43c2e0b9f0720052bf83e8aed3566f4"
server_key_iv: "99a934f4e327479985939ca7c5a9d8aa"
server_key_version: "encryptionkey@0"
I20260618 23:24:08.550318 26537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:24:08.562222 26537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:24:08.564584 26537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:24:08.564751 26537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:24:08.568814 26537 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.190:42449
I20260618 23:24:08.568863 26604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.190:42449 every 8 connection(s)
I20260618 23:24:08.569216 26537 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-0/data/info.pb
I20260618 23:24:08.570183 26605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:24:08.571728 26605 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42449 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:24:08.577291 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 26537
I20260618 23:24:08.577420 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-0/wal/instance
I20260618 23:24:08.577615 3942 external_mini_cluster.cc:1428] Setting key ee160421b52d0a2f01d214a0c71f4cde
Jun 18 23:24:08 dist-test-slave-r9ct krb5kdc[26524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825048, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:24:08.582365 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.572310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:42449 (local address 127.0.0.1:47820)
0618 23:24:08.572533 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.572574 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0618 23:24:08.573082 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:24:08.573379 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:24:08.573381 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:24:08.573646 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:24:08.573781 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:08.573785 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.574830 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.574831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:08.575474 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:08.575476 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.575999 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.576000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:08.576061 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:08.576509 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:24:08.576517 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:24:08.578150 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:24:08.580286 (+ 2136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:08.580303 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:08.580307 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:08.580717 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:08.581079 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:08.581080 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:08.581081 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:08.581201 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:08.581630 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:24:08.581638 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:24:08.581719 (+ 81us) client_negotiation.cc:769] Sending connection context
0618 23:24:08.581846 (+ 127us) client_negotiation.cc:240] Negotiation successful
0618 23:24:08.582065 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":98,"threads_started":1}
I20260618 23:24:08.582803 26608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.572383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47820 (local address 127.3.217.190:42449)
0618 23:24:08.572542 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:08.572551 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:08.572676 (+ 125us) server_negotiation.cc:407] Connection header received
0618 23:24:08.573244 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:08.573246 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:08.573265 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:08.573373 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:08.573886 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.574678 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.575577 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.575885 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.576013 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:08.578236 (+ 2223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:08.578245 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:08.578245 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:08.578252 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:08.580129 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:08.580874 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:08.580877 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:08.580877 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:08.580976 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:08.581282 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:08.581282 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:08.581283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:08.581502 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:08.581577 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:08.581957 (+ 380us) server_negotiation.cc:299] Negotiation successful
0618 23:24:08.582181 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":96,"server-negotiator.queue_time_us":122,"thread_start_us":79,"threads_started":1}
I20260618 23:24:08.583521 26605 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:24:08.583876 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.583754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:43125 (local address 127.0.0.1:50830)
0618 23:24:08.583809 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.583855 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.189:43125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260618 23:24:08.584045 26555 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.217.189:43125: connect: Connection refused (error 111)
I20260618 23:24:08.584513 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.584403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:43125 (local address 127.0.0.1:50840)
0618 23:24:08.584466 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.584494 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.189:43125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260618 23:24:08.584653 26605 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.189:43125: Network error: Client connection negotiation failed: client connection to 127.3.217.189:43125: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.3.217.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.189.keytab.
Entry for principal kudu/127.3.217.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.189.keytab.
I20260618 23:24:08.607039 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.189:43125
--webserver_interface=127.3.217.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.189.keytab
--principal=kudu/127.3.217.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:41865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:42449,127.3.217.189:43125,127.3.217.188:33867
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260618 23:24:08.633932 26605 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } attempt: 1
I20260618 23:24:08.634591 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.634436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:43125 (local address 127.0.0.1:50850)
0618 23:24:08.634516 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.634562 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.189:43125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260618 23:24:08.634999 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.634899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:43125 (local address 127.0.0.1:50852)
0618 23:24:08.634948 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.634976 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.189:43125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260618 23:24:08.635090 26605 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.189:43125: Network error: Client connection negotiation failed: client connection to 127.3.217.189:43125: connect: Connection refused (error 111)
W20260618 23:24:08.690641 26612 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260618 23:24:08.690891 26612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:24:08.690909 26612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:24:08.690932 26612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:24:08.692291 26612 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:24:08.692338 26612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:24:08.692354 26612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:24:08.692368 26612 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:24:08.692382 26612 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:24:08.694007 26612 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:41865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:42449,127.3.217.189:43125,127.3.217.188:33867
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.189.keytab
--principal=kudu/127.3.217.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.189:43125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.3.217.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:24:08.694275 26612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:24:08.694530 26612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:24:08.699565 26617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:24:08.699503 26618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:24:08.699506 26620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:24:08.699973 26612 server_base.cc:1034] running on GCE node
I20260618 23:24:08.700213 26612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:24:08.700493 26612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:24:08.701642 26612 hybrid_clock.cc:648] HybridClock initialized: now 1781825048701632 us; error 29 us; skew 500 ppm
I20260618 23:24:08.703274 26605 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } attempt: 2
I20260618 23:24:08.703986 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.703843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:43125 (local address 127.0.0.1:50868)
0618 23:24:08.703922 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.703959 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.189:43125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260618 23:24:08.704358 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.704266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:43125 (local address 127.0.0.1:50882)
0618 23:24:08.704309 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.704333 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.189:43125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260618 23:24:08.704442 26605 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.189:43125: Network error: Client connection negotiation failed: client connection to 127.3.217.189:43125: connect: Connection refused (error 111)
Jun 18 23:24:08 dist-test-slave-r9ct krb5kdc[26524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825048, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:24:08.705129 26612 init.cc:377] Logged in from keytab as kudu/127.3.217.189@KRBTEST.COM (short username kudu)
I20260618 23:24:08.705786 26612 webserver.cc:460] Webserver started at http://127.3.217.189:40157/ using document root <none> and password file <none>
I20260618 23:24:08.706146 26612 fs_manager.cc:359] Metadata directory not provided
I20260618 23:24:08.706228 26612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:24:08.706404 26612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:24:08.707858 26612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-1/data/instance:
uuid: "10486b8b8f254b13b7184d58b283edbb"
format_stamp: "Formatted at 2026-06-18 23:24:08 on dist-test-slave-r9ct"
server_key: "0bfaff6922ce2b18bd5ba8f15b2f0c19"
server_key_iv: "bbb909cd77a5219f65a550a5b4938559"
server_key_version: "encryptionkey@0"
I20260618 23:24:08.708283 26612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-1/wal/instance:
uuid: "10486b8b8f254b13b7184d58b283edbb"
format_stamp: "Formatted at 2026-06-18 23:24:08 on dist-test-slave-r9ct"
server_key: "0bfaff6922ce2b18bd5ba8f15b2f0c19"
server_key_iv: "bbb909cd77a5219f65a550a5b4938559"
server_key_version: "encryptionkey@0"
I20260618 23:24:08.709766 26612 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260618 23:24:08.710846 26627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:24:08.711229 26612 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 23:24:08.711445 26612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-1/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-1/wal
uuid: "10486b8b8f254b13b7184d58b283edbb"
format_stamp: "Formatted at 2026-06-18 23:24:08 on dist-test-slave-r9ct"
server_key: "0bfaff6922ce2b18bd5ba8f15b2f0c19"
server_key_iv: "bbb909cd77a5219f65a550a5b4938559"
server_key_version: "encryptionkey@0"
I20260618 23:24:08.711697 26612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:24:08.735569 26612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:24:08.738085 26612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:24:08.738256 26612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:24:08.743008 26612 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.189:43125
I20260618 23:24:08.743042 26679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.189:43125 every 8 connection(s)
I20260618 23:24:08.743438 26612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-1/data/info.pb
I20260618 23:24:08.744377 26680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:24:08.745829 26680 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42449 } has no permanent_uuid. Determining permanent_uuid...
Jun 18 23:24:08 dist-test-slave-r9ct krb5kdc[26524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825048, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.189@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:24:08.752059 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 26612
I20260618 23:24:08.752159 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-1/wal/instance
I20260618 23:24:08.752383 3942 external_mini_cluster.cc:1428] Setting key 21d0d54308e40132977182db71052633
I20260618 23:24:08.755708 26608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.746586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47828 (local address 127.3.217.190:42449)
0618 23:24:08.746675 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:08.746676 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:08.746824 (+ 148us) server_negotiation.cc:407] Connection header received
0618 23:24:08.747370 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:08.747373 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:08.747396 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:08.747510 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:08.748170 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.748689 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.749661 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.749994 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.750063 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:08.752440 (+ 2377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:08.752442 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:08.752443 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:08.752452 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:08.754158 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:08.754678 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:08.754679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:08.754680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:08.754801 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:08.755069 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:08.755070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:08.755070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:08.755186 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:08.755275 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:08.755537 (+ 262us) server_negotiation.cc:299] Negotiation successful
0618 23:24:08.755618 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260618 23:24:08.756018 26682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.746495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:42449 (local address 127.0.0.1:47828)
0618 23:24:08.746663 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.746727 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0618 23:24:08.747196 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:24:08.747579 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:24:08.747581 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:24:08.747840 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:24:08.748029 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:08.748032 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.748798 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.748799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:08.749572 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:08.749575 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.750096 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.750097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:08.750200 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:08.750811 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:24:08.750819 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:24:08.752274 (+ 1455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:24:08.754331 (+ 2057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:08.754348 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:08.754350 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:08.754586 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:08.754864 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:08.754865 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:08.754866 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:08.754978 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:08.755269 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:24:08.755275 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:24:08.755410 (+ 135us) client_negotiation.cc:769] Sending connection context
0618 23:24:08.755517 (+ 107us) client_negotiation.cc:240] Negotiation successful
0618 23:24:08.755666 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":83,"threads_started":1}
I20260618 23:24:08.756494 26680 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.3.217.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.217.188@KRBTEST.COM" created.
Jun 18 23:24:08 dist-test-slave-r9ct krb5kdc[26524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825048, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.189@KRBTEST.COM for kudu/127.3.217.189@KRBTEST.COM
I20260618 23:24:08.766829 26682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.756774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:43125 (local address 127.0.0.1:50896)
0618 23:24:08.756821 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.756830 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0618 23:24:08.756871 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:24:08.757086 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:24:08.757087 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:24:08.757229 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:24:08.757273 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:08.757274 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.758103 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.758104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:08.758596 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:08.758597 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.759107 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.759108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:08.759169 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:08.759601 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:24:08.759605 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:24:08.763524 (+ 3919us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:24:08.765450 (+ 1926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:08.765451 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:08.765451 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:08.765612 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:08.765852 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:08.765853 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:08.765853 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:08.765906 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:08.766472 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:24:08.766473 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:24:08.766515 (+ 42us) client_negotiation.cc:769] Sending connection context
0618 23:24:08.766585 (+ 70us) client_negotiation.cc:240] Negotiation successful
0618 23:24:08.766699 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260618 23:24:08.766894 26684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.756850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50896 (local address 127.3.217.189:43125)
0618 23:24:08.756967 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:08.756971 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:08.756983 (+ 12us) server_negotiation.cc:407] Connection header received
0618 23:24:08.756997 (+ 14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:08.756999 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:08.757009 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:08.757085 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:08.757345 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.758005 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.758688 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.759019 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.759108 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:08.763611 (+ 4503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:08.763620 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:08.763620 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:08.763633 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:08.765341 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:08.765703 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:08.765706 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:08.765706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:08.765761 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:08.765974 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:08.765975 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:08.765975 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:08.766386 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:08.766492 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:08.766651 (+ 159us) server_negotiation.cc:299] Negotiation successful
0618 23:24:08.766771 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":98,"thread_start_us":74,"threads_started":1}
I20260618 23:24:08.767436 26680 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:24:08.767789 26682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.767670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:33867 (local address 127.0.0.1:52478)
0618 23:24:08.767719 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.767761 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:33867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260618 23:24:08.767904 26630 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.217.188:33867: connect: Connection refused (error 111)
I20260618 23:24:08.768301 26682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.768205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:33867 (local address 127.0.0.1:52480)
0618 23:24:08.768256 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.768280 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:33867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260618 23:24:08.768397 26680 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.188:33867: Network error: Client connection negotiation failed: client connection to 127.3.217.188:33867: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.217.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.188.keytab.
Entry for principal kudu/127.3.217.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.188.keytab.
I20260618 23:24:08.782181 3942 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskY_cj0P/build/release/bin/kudu
/tmp/dist-test-taskY_cj0P/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.188:33867
--webserver_interface=127.3.217.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.188.keytab
--principal=kudu/127.3.217.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.217.148:41865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.217.190:42449,127.3.217.189:43125,127.3.217.188:33867
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260618 23:24:08.795560 26605 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } attempt: 3
Jun 18 23:24:08 dist-test-slave-r9ct krb5kdc[26524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825048, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for kudu/127.3.217.189@KRBTEST.COM
I20260618 23:24:08.802872 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.795933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:43125 (local address 127.0.0.1:50898)
0618 23:24:08.795989 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.795999 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0618 23:24:08.796064 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:24:08.796209 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:24:08.796209 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:24:08.796377 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:24:08.796438 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:08.796440 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.797117 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.797118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:08.797646 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:08.797647 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.798369 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.798371 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:08.798457 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:08.799019 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:24:08.799024 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:24:08.800164 (+ 1140us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:24:08.801813 (+ 1649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:08.801814 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:08.801814 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:08.801979 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:08.802188 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:08.802189 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:08.802189 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:08.802243 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:08.802492 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:24:08.802493 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:24:08.802535 (+ 42us) client_negotiation.cc:769] Sending connection context
0618 23:24:08.802629 (+ 94us) client_negotiation.cc:240] Negotiation successful
0618 23:24:08.802772 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260618 23:24:08.802872 26684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.796001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50898 (local address 127.3.217.189:43125)
0618 23:24:08.796060 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:08.796062 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:08.796072 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:24:08.796133 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:08.796134 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:08.796146 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:08.796203 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:08.796520 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.797037 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.797754 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.798251 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.798367 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:08.800315 (+ 1948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:08.800316 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:08.800316 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:08.800322 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:08.801687 (+ 1365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:08.802064 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:08.802065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:08.802066 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:08.802122 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:08.802316 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:08.802317 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:08.802317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:08.802426 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:08.802501 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:08.802656 (+ 155us) server_negotiation.cc:299] Negotiation successful
0618 23:24:08.802773 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260618 23:24:08.803215 26605 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:24:08.803524 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.803445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:33867 (local address 127.0.0.1:52484)
0618 23:24:08.803475 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.803502 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:33867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
I20260618 23:24:08.803804 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.803720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:33867 (local address 127.0.0.1:52492)
0618 23:24:08.803764 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.803786 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:33867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260618 23:24:08.803936 26605 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.188:33867: Network error: Client connection negotiation failed: client connection to 127.3.217.188:33867: connect: Connection refused (error 111)
I20260618 23:24:08.817618 26680 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } attempt: 1
I20260618 23:24:08.818082 26682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.817956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:33867 (local address 127.0.0.1:52500)
0618 23:24:08.818012 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.818048 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:33867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260618 23:24:08.818401 26682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.818308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:33867 (local address 127.0.0.1:52508)
0618 23:24:08.818354 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.818377 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:33867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260618 23:24:08.818478 26680 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.188:33867: Network error: Client connection negotiation failed: client connection to 127.3.217.188:33867: connect: Connection refused (error 111)
I20260618 23:24:08.835088 26605 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } attempt: 1
I20260618 23:24:08.835589 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.835463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:33867 (local address 127.0.0.1:52518)
0618 23:24:08.835522 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.835563 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:33867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260618 23:24:08.835942 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.835842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:33867 (local address 127.0.0.1:52534)
0618 23:24:08.835889 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.835918 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:33867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260618 23:24:08.836031 26605 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.188:33867: Network error: Client connection negotiation failed: client connection to 127.3.217.188:33867: connect: Connection refused (error 111)
W20260618 23:24:08.867929 26687 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260618 23:24:08.868150 26687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260618 23:24:08.868167 26687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260618 23:24:08.868188 26687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260618 23:24:08.869340 26687 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260618 23:24:08.869379 26687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260618 23:24:08.869393 26687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260618 23:24:08.869405 26687 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260618 23:24:08.869457 26687 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260618 23:24:08.870946 26687 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.217.148:41865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.3.217.190:42449,127.3.217.189:43125,127.3.217.188:33867
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/krb5kdc/kudu_127.3.217.188.keytab
--principal=kudu/127.3.217.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.217.188:33867
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.3.217.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26687
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 18 Jun 2026 22:23:54 UTC on ccycloud.quasar-uzckeu.root.comops.site
build id 4454735
I20260618 23:24:08.871205 26687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 23:24:08.871441 26687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260618 23:24:08.876307 26695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:24:08.876456 26692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 23:24:08.876317 26693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 23:24:08.876636 26687 server_base.cc:1034] running on GCE node
I20260618 23:24:08.876988 26687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260618 23:24:08.877303 26687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260618 23:24:08.878530 26687 hybrid_clock.cc:648] HybridClock initialized: now 1781825048878493 us; error 66 us; skew 500 ppm
Jun 18 23:24:08 dist-test-slave-r9ct krb5kdc[26524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825048, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260618 23:24:08.881759 26687 init.cc:377] Logged in from keytab as kudu/127.3.217.188@KRBTEST.COM (short username kudu)
I20260618 23:24:08.882194 26687 webserver.cc:460] Webserver started at http://127.3.217.188:40977/ using document root <none> and password file <none>
I20260618 23:24:08.882431 26687 fs_manager.cc:359] Metadata directory not provided
I20260618 23:24:08.882500 26687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 23:24:08.882858 26687 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 23:24:08.883962 26687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-2/data/instance:
uuid: "533b567389a64507834e17d2ceabd3e5"
format_stamp: "Formatted at 2026-06-18 23:24:08 on dist-test-slave-r9ct"
server_key: "72b03f9ac9cf6c2399c2bd99bb3d9eec"
server_key_iv: "9c8a127cda544bb2d22afc07d0079681"
server_key_version: "encryptionkey@0"
I20260618 23:24:08.884341 26687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-2/wal/instance:
uuid: "533b567389a64507834e17d2ceabd3e5"
format_stamp: "Formatted at 2026-06-18 23:24:08 on dist-test-slave-r9ct"
server_key: "72b03f9ac9cf6c2399c2bd99bb3d9eec"
server_key_iv: "9c8a127cda544bb2d22afc07d0079681"
server_key_version: "encryptionkey@0"
I20260618 23:24:08.885807 26687 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260618 23:24:08.886639 26680 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } attempt: 2
I20260618 23:24:08.887200 26682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.887021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:33867 (local address 127.0.0.1:52548)
0618 23:24:08.887114 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.887155 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:33867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260618 23:24:08.887647 26702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 23:24:08.887805 26682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.887621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:33867 (local address 127.0.0.1:52550)
0618 23:24:08.887698 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.887761 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:33867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260618 23:24:08.887859 26687 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
W20260618 23:24:08.887923 26680 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.188:33867: Network error: Client connection negotiation failed: client connection to 127.3.217.188:33867: connect: Connection refused (error 111)
I20260618 23:24:08.887959 26687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-2/data,/tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-2/wal
uuid: "533b567389a64507834e17d2ceabd3e5"
format_stamp: "Formatted at 2026-06-18 23:24:08 on dist-test-slave-r9ct"
server_key: "72b03f9ac9cf6c2399c2bd99bb3d9eec"
server_key_iv: "9c8a127cda544bb2d22afc07d0079681"
server_key_version: "encryptionkey@0"
I20260618 23:24:08.888046 26687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 23:24:08.911181 26605 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } attempt: 2
I20260618 23:24:08.911620 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.911496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:33867 (local address 127.0.0.1:52556)
0618 23:24:08.911559 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.911595 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:33867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260618 23:24:08.911971 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.911877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:33867 (local address 127.0.0.1:52562)
0618 23:24:08.911922 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.911945 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.217.188:33867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260618 23:24:08.912056 26605 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.217.188:33867: Network error: Client connection negotiation failed: client connection to 127.3.217.188:33867: connect: Connection refused (error 111)
I20260618 23:24:08.917832 26687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260618 23:24:08.920091 26687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 23:24:08.920291 26687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 23:24:08.924223 26687 rpc_server.cc:307] RPC server started. Bound to: 127.3.217.188:33867
I20260618 23:24:08.924335 26754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.217.188:33867 every 8 connection(s)
I20260618 23:24:08.924664 26687 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-2/data/info.pb
I20260618 23:24:08.925824 26755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 23:24:08.927834 3942 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskY_cj0P/build/release/bin/kudu as pid 26687
I20260618 23:24:08.927973 3942 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskY_cj0P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781824769284800-3942-0/minicluster-data/master-2/wal/instance
I20260618 23:24:08.927839 26755 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42449 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:24:08.928236 3942 external_mini_cluster.cc:1428] Setting key 589a15b0e3e54609b3e897b39117b4c6
Jun 18 23:24:08 dist-test-slave-r9ct krb5kdc[26524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825048, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.188@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
Jun 18 23:24:08 dist-test-slave-r9ct krb5kdc[26524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825048, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.188@KRBTEST.COM
I20260618 23:24:08.938814 26608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.928904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47840 (local address 127.3.217.190:42449)
0618 23:24:08.928988 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:08.928989 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:08.929231 (+ 242us) server_negotiation.cc:407] Connection header received
0618 23:24:08.929852 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:08.929853 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:08.929866 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:08.929943 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:08.930448 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.931038 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.932169 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.932529 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.932660 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:08.935419 (+ 2759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:08.935420 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:08.935420 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:08.935428 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:08.937181 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:08.937688 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:08.937689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:08.937690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:08.937754 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:08.938027 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:08.938028 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:08.938029 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:08.938188 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:08.938278 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:08.938596 (+ 318us) server_negotiation.cc:299] Negotiation successful
0618 23:24:08.938662 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260618 23:24:08.939047 26758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.928898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.190:42449 (local address 127.0.0.1:47840)
0618 23:24:08.929085 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.929118 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0618 23:24:08.929690 (+ 572us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:24:08.929974 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:24:08.929976 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:24:08.930210 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:24:08.930352 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:08.930356 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.931113 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.931114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:08.932042 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:08.932044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.932697 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.932698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:08.932845 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:08.933476 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:24:08.933483 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:24:08.935228 (+ 1745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:24:08.937332 (+ 2104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:08.937339 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:08.937341 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:08.937607 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:08.937825 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:08.937825 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:08.937826 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:08.937936 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:08.938281 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:24:08.938288 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:24:08.938422 (+ 134us) client_negotiation.cc:769] Sending connection context
0618 23:24:08.938573 (+ 151us) client_negotiation.cc:240] Negotiation successful
0618 23:24:08.938768 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":36,"thread_start_us":87,"threads_started":1}
I20260618 23:24:08.939579 26755 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:24:08.939790 26759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.929069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52568 (local address 127.3.217.188:33867)
0618 23:24:08.929199 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:08.929214 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:08.929244 (+ 30us) server_negotiation.cc:407] Connection header received
0618 23:24:08.929694 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:08.929702 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:08.929733 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:08.929827 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:08.930518 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.931643 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.932866 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.933265 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.933347 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:08.936360 (+ 3013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:08.936366 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:08.936366 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:08.936372 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:08.938430 (+ 2058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:08.938853 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:08.938856 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:08.938857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:08.938938 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:08.939173 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:08.939174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:08.939175 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:08.939349 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:08.939509 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:08.939599 (+ 90us) server_negotiation.cc:299] Negotiation successful
0618 23:24:08.939680 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":55,"threads_started":1}
Jun 18 23:24:08 dist-test-slave-r9ct krb5kdc[26524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825048, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.188@KRBTEST.COM for kudu/127.3.217.189@KRBTEST.COM
Jun 18 23:24:08 dist-test-slave-r9ct krb5kdc[26524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825048, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.190@KRBTEST.COM
I20260618 23:24:08.947427 26684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.940093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50900 (local address 127.3.217.189:43125)
0618 23:24:08.940159 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:08.940160 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:08.940167 (+ 7us) server_negotiation.cc:407] Connection header received
0618 23:24:08.940188 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:08.940189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:08.940197 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:08.940267 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:08.940582 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.941328 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.942255 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.942606 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.942689 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:08.944634 (+ 1945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:08.944636 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:08.944636 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:08.944642 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:08.946291 (+ 1649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:08.946629 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:08.946630 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:08.946630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:08.946686 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:08.946919 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:08.946921 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:08.946921 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:08.947034 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:08.947114 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:08.947276 (+ 162us) server_negotiation.cc:299] Negotiation successful
0618 23:24:08.947344 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260618 23:24:08.947423 26758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.939861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.189:43125 (local address 127.0.0.1:50900)
0618 23:24:08.939897 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.939910 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0618 23:24:08.939952 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:24:08.940270 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:24:08.940271 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:24:08.940463 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:24:08.940492 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:08.940494 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.941421 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.941422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:08.942172 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:08.942174 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.942771 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.942772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:08.942832 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:08.943183 (+ 351us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:24:08.943188 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:24:08.944514 (+ 1326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:24:08.946376 (+ 1862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:08.946377 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:08.946377 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:08.946548 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:08.946792 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:08.946792 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:08.946793 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:08.946852 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:08.947107 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:24:08.947108 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:24:08.947151 (+ 43us) client_negotiation.cc:769] Sending connection context
0618 23:24:08.947237 (+ 86us) client_negotiation.cc:240] Negotiation successful
0618 23:24:08.947331 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260618 23:24:08.947788 26755 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } has no permanent_uuid. Determining permanent_uuid...
I20260618 23:24:08.948608 26608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.940554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47850 (local address 127.3.217.190:42449)
0618 23:24:08.940593 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:08.940595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:08.940604 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:24:08.940624 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:08.940625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:08.940632 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:08.940676 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:08.941245 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.941980 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.942940 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.943268 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.943342 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:08.945742 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:08.945743 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:08.945744 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:08.945750 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:08.947236 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:08.947792 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:08.947793 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:08.947793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:08.947847 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:08.948119 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:08.948120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:08.948120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:08.948231 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:08.948383 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:08.948445 (+ 62us) server_negotiation.cc:299] Negotiation successful
0618 23:24:08.948516 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
Jun 18 23:24:08 dist-test-slave-r9ct krb5kdc[26524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825048, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.188@KRBTEST.COM for kudu/127.3.217.188@KRBTEST.COM
Jun 18 23:24:08 dist-test-slave-r9ct krb5kdc[26524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825048, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.217.189@KRBTEST.COM
I20260618 23:24:08.955003 26758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.948034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:33867 (local address 127.0.0.1:52580)
0618 23:24:08.948138 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.948149 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0618 23:24:08.948193 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:24:08.948326 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:24:08.948327 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:24:08.948452 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:24:08.948475 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:08.948476 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.949356 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.949357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:08.949830 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:08.949831 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.950217 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.950217 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:08.950269 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:08.950679 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:24:08.950684 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:24:08.952136 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:24:08.953996 (+ 1860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:08.953997 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:08.953998 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:08.954177 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:08.954387 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:08.954388 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:08.954388 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:08.954462 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:08.954790 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:24:08.954791 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:24:08.954826 (+ 35us) client_negotiation.cc:769] Sending connection context
0618 23:24:08.954880 (+ 54us) client_negotiation.cc:240] Negotiation successful
0618 23:24:08.954944 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91}
I20260618 23:24:08.955356 26759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.948099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52580 (local address 127.3.217.188:33867)
0618 23:24:08.948148 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:08.948151 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:08.948179 (+ 28us) server_negotiation.cc:407] Connection header received
0618 23:24:08.948244 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:08.948245 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:08.948254 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:08.948323 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:08.948544 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.949281 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.949923 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.950136 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.950217 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:08.952237 (+ 2020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:08.952238 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:08.952238 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:08.952244 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:08.953871 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:08.954248 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:08.954249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:08.954249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:08.954305 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:08.954527 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:08.954528 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:08.954528 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:08.954662 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:08.954757 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:08.954928 (+ 171us) server_negotiation.cc:299] Negotiation successful
0618 23:24:08.955005 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260618 23:24:08.956410 26684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.949174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50902 (local address 127.3.217.189:43125)
0618 23:24:08.949210 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:08.949212 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:08.949220 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:24:08.949238 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:08.949239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:08.949247 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:08.949294 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:08.949739 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.950186 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.950904 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.951123 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.951199 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:08.953465 (+ 2266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:08.953466 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:08.953467 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:08.953473 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:08.955254 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:08.955617 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:08.955618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:08.955618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:08.955665 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:08.955937 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:08.955938 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:08.955939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:08.956083 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:08.956230 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:08.956266 (+ 36us) server_negotiation.cc:299] Negotiation successful
0618 23:24:08.956333 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260618 23:24:08.957033 26755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 533b567389a64507834e17d2ceabd3e5: Bootstrap starting.
I20260618 23:24:08.958112 26755 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 533b567389a64507834e17d2ceabd3e5: Neither blocks nor log segments found. Creating new log.
I20260618 23:24:08.958115 3942 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260618 23:24:08.958406 26755 log.cc:824] T 00000000000000000000000000000000 P 533b567389a64507834e17d2ceabd3e5: Log is configured to *not* fsync() on all Append() calls
I20260618 23:24:08.959368 26755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 533b567389a64507834e17d2ceabd3e5: No bootstrap required, opened a new log
I20260618 23:24:08.959336 26579 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "cae64a87681348e18c55e05d1660d430"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47850
I20260618 23:24:08.960892 26755 raft_consensus.cc:348] T 00000000000000000000000000000000 P 533b567389a64507834e17d2ceabd3e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cae64a87681348e18c55e05d1660d430" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42449 } } peers { permanent_uuid: "10486b8b8f254b13b7184d58b283edbb" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } } peers { permanent_uuid: "533b567389a64507834e17d2ceabd3e5" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } }
I20260618 23:24:08.961006 26755 raft_consensus.cc:729] T 00000000000000000000000000000000 P 533b567389a64507834e17d2ceabd3e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 533b567389a64507834e17d2ceabd3e5, State: Initialized, Role: FOLLOWER
I20260618 23:24:08.961090 26755 consensus_queue.cc:260] T 00000000000000000000000000000000 P 533b567389a64507834e17d2ceabd3e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cae64a87681348e18c55e05d1660d430" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42449 } } peers { permanent_uuid: "10486b8b8f254b13b7184d58b283edbb" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } } peers { permanent_uuid: "533b567389a64507834e17d2ceabd3e5" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } }
I20260618 23:24:08.961409 26755 sys_catalog.cc:564] T 00000000000000000000000000000000 P 533b567389a64507834e17d2ceabd3e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:24:08.961410 26761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 533b567389a64507834e17d2ceabd3e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cae64a87681348e18c55e05d1660d430" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42449 } } peers { permanent_uuid: "10486b8b8f254b13b7184d58b283edbb" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } } peers { permanent_uuid: "533b567389a64507834e17d2ceabd3e5" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } } }
I20260618 23:24:08.961532 26761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 533b567389a64507834e17d2ceabd3e5 [sys.catalog]: This master's current role is: FOLLOWER
W20260618 23:24:08.963110 26772 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 533b567389a64507834e17d2ceabd3e5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260618 23:24:08.963166 26772 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260618 23:24:08.963423 26687 master_runner.cc:186] Error getting master registration for 127.3.217.190:42449: OK, instance_id { permanent_uuid: "cae64a87681348e18c55e05d1660d430" instance_seqno: 1781825048567589 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260618 23:24:08.966107 26687 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260618 23:24:08.979074 26680 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } attempt: 3
Jun 18 23:24:08 dist-test-slave-r9ct krb5kdc[26524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825048, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.189@KRBTEST.COM for kudu/127.3.217.188@KRBTEST.COM
I20260618 23:24:08.986220 26682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.979417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:33867 (local address 127.0.0.1:52586)
0618 23:24:08.979489 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:08.979501 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:24:08.979568 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:24:08.979732 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:24:08.979733 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:24:08.979906 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:24:08.979950 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:08.979951 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.980601 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.980602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:08.981111 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:08.981112 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.981493 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.981494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:08.981551 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:08.982010 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:24:08.982016 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:24:08.983330 (+ 1314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:24:08.985089 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:08.985090 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:08.985090 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:08.985311 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:08.985511 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:08.985512 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:08.985512 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:08.985571 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:08.985886 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:24:08.985887 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:24:08.985930 (+ 43us) client_negotiation.cc:769] Sending connection context
0618 23:24:08.986005 (+ 75us) client_negotiation.cc:240] Negotiation successful
0618 23:24:08.986116 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260618 23:24:08.986220 26759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:08.979498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52586 (local address 127.3.217.188:33867)
0618 23:24:08.979561 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:08.979564 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:08.979574 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:24:08.979630 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:08.979631 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:08.979641 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:08.979715 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:08.980030 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.980517 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.981197 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:08.981391 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:08.981479 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:08.983424 (+ 1945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:08.983425 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:08.983426 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:08.983433 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:08.984997 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:08.985385 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:08.985386 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:08.985387 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:08.985445 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:08.985636 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:08.985637 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:08.985638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:08.985821 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:08.985891 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:08.986034 (+ 143us) server_negotiation.cc:299] Negotiation successful
0618 23:24:08.986126 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260618 23:24:08.988210 26680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10486b8b8f254b13b7184d58b283edbb: Bootstrap starting.
I20260618 23:24:08.988927 26680 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10486b8b8f254b13b7184d58b283edbb: Neither blocks nor log segments found. Creating new log.
I20260618 23:24:08.989223 26680 log.cc:824] T 00000000000000000000000000000000 P 10486b8b8f254b13b7184d58b283edbb: Log is configured to *not* fsync() on all Append() calls
I20260618 23:24:08.990165 26680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10486b8b8f254b13b7184d58b283edbb: No bootstrap required, opened a new log
I20260618 23:24:08.992268 26680 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10486b8b8f254b13b7184d58b283edbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cae64a87681348e18c55e05d1660d430" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42449 } } peers { permanent_uuid: "10486b8b8f254b13b7184d58b283edbb" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } } peers { permanent_uuid: "533b567389a64507834e17d2ceabd3e5" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } }
I20260618 23:24:08.992411 26680 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10486b8b8f254b13b7184d58b283edbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10486b8b8f254b13b7184d58b283edbb, State: Initialized, Role: FOLLOWER
I20260618 23:24:08.992496 26680 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10486b8b8f254b13b7184d58b283edbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cae64a87681348e18c55e05d1660d430" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42449 } } peers { permanent_uuid: "10486b8b8f254b13b7184d58b283edbb" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } } peers { permanent_uuid: "533b567389a64507834e17d2ceabd3e5" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } }
I20260618 23:24:08.992756 26775 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10486b8b8f254b13b7184d58b283edbb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cae64a87681348e18c55e05d1660d430" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42449 } } peers { permanent_uuid: "10486b8b8f254b13b7184d58b283edbb" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } } peers { permanent_uuid: "533b567389a64507834e17d2ceabd3e5" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } } }
I20260618 23:24:08.992821 26680 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10486b8b8f254b13b7184d58b283edbb [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:24:08.992853 26775 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10486b8b8f254b13b7184d58b283edbb [sys.catalog]: This master's current role is: FOLLOWER
W20260618 23:24:08.994534 26786 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 10486b8b8f254b13b7184d58b283edbb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260618 23:24:08.994633 26786 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260618 23:24:08.994679 26612 master_runner.cc:186] Error getting master registration for 127.3.217.190:42449: OK, instance_id { permanent_uuid: "cae64a87681348e18c55e05d1660d430" instance_seqno: 1781825048567589 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260618 23:24:08.997462 26612 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260618 23:24:09.011201 26605 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } attempt: 3
Jun 18 23:24:09 dist-test-slave-r9ct krb5kdc[26524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781825048, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.217.190@KRBTEST.COM for kudu/127.3.217.188@KRBTEST.COM
I20260618 23:24:09.020757 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:09.011549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.217.188:33867 (local address 127.0.0.1:52592)
0618 23:24:09.011602 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0618 23:24:09.011614 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0618 23:24:09.011654 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0618 23:24:09.011877 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0618 23:24:09.011878 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0618 23:24:09.012067 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0618 23:24:09.012117 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:09.012119 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:09.013081 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:09.013082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:09.013925 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0618 23:24:09.013927 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0618 23:24:09.014392 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0618 23:24:09.014393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0618 23:24:09.014446 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:09.015101 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0618 23:24:09.015106 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0618 23:24:09.016661 (+ 1555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0618 23:24:09.019663 (+ 3002us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:09.019664 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:09.019665 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:09.019885 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:09.020101 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0618 23:24:09.020101 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0618 23:24:09.020102 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0618 23:24:09.020160 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0618 23:24:09.020439 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0618 23:24:09.020440 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0618 23:24:09.020485 (+ 45us) client_negotiation.cc:769] Sending connection context
0618 23:24:09.020552 (+ 67us) client_negotiation.cc:240] Negotiation successful
0618 23:24:09.020652 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260618 23:24:09.020783 26759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:09.011647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52592 (local address 127.3.217.188:33867)
0618 23:24:09.011739 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:09.011741 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:09.011749 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:24:09.011774 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:09.011775 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:09.011785 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:09.011831 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:09.012221 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:09.012984 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:09.014004 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:09.014307 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:09.014377 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:09.016754 (+ 2377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:09.016755 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:09.016756 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:09.016764 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:09.019579 (+ 2815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:09.019969 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:09.019970 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:09.019970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:09.020034 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:09.020224 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:09.020225 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:09.020225 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:09.020363 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:09.020442 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:09.020592 (+ 150us) server_negotiation.cc:299] Negotiation successful
0618 23:24:09.020680 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260618 23:24:09.022960 26605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430: Bootstrap starting.
I20260618 23:24:09.023727 26605 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430: Neither blocks nor log segments found. Creating new log.
I20260618 23:24:09.024147 26605 log.cc:824] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430: Log is configured to *not* fsync() on all Append() calls
I20260618 23:24:09.025134 26605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430: No bootstrap required, opened a new log
I20260618 23:24:09.026526 26605 raft_consensus.cc:348] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cae64a87681348e18c55e05d1660d430" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42449 } } peers { permanent_uuid: "10486b8b8f254b13b7184d58b283edbb" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } } peers { permanent_uuid: "533b567389a64507834e17d2ceabd3e5" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } }
I20260618 23:24:09.026662 26605 raft_consensus.cc:729] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cae64a87681348e18c55e05d1660d430, State: Initialized, Role: FOLLOWER
I20260618 23:24:09.026773 26605 consensus_queue.cc:260] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cae64a87681348e18c55e05d1660d430" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42449 } } peers { permanent_uuid: "10486b8b8f254b13b7184d58b283edbb" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } } peers { permanent_uuid: "533b567389a64507834e17d2ceabd3e5" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } }
I20260618 23:24:09.027068 26605 sys_catalog.cc:564] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 23:24:09.027242 26579 raft_consensus.cc:482] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260618 23:24:09.027309 26579 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:24:09.028119 26579 raft_consensus.cc:504] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cae64a87681348e18c55e05d1660d430" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42449 } } peers { permanent_uuid: "10486b8b8f254b13b7184d58b283edbb" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } } peers { permanent_uuid: "533b567389a64507834e17d2ceabd3e5" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } }
I20260618 23:24:09.028348 26579 leader_election.cc:288] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430 [CANDIDATE]: Term 1 election: Requested vote from peers 10486b8b8f254b13b7184d58b283edbb (127.3.217.189:43125), 533b567389a64507834e17d2ceabd3e5 (127.3.217.188:33867)
W20260618 23:24:09.029309 26800 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260618 23:24:09.029366 26800 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260618 23:24:09.030135 26654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cae64a87681348e18c55e05d1660d430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "10486b8b8f254b13b7184d58b283edbb"
I20260618 23:24:09.030277 26654 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10486b8b8f254b13b7184d58b283edbb [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:24:09.031283 26654 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 10486b8b8f254b13b7184d58b283edbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cae64a87681348e18c55e05d1660d430 in term 1.
I20260618 23:24:09.031507 26729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cae64a87681348e18c55e05d1660d430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "533b567389a64507834e17d2ceabd3e5"
I20260618 23:24:09.031636 26729 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 533b567389a64507834e17d2ceabd3e5 [term 0 FOLLOWER]: Advancing to term 1
I20260618 23:24:09.032557 26729 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 533b567389a64507834e17d2ceabd3e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cae64a87681348e18c55e05d1660d430 in term 1.
I20260618 23:24:09.033201 26555 leader_election.cc:302] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 533b567389a64507834e17d2ceabd3e5, cae64a87681348e18c55e05d1660d430; no voters:
I20260618 23:24:09.034847 26789 sys_catalog.cc:455] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cae64a87681348e18c55e05d1660d430" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42449 } } peers { permanent_uuid: "10486b8b8f254b13b7184d58b283edbb" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } } peers { permanent_uuid: "533b567389a64507834e17d2ceabd3e5" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } } }
I20260618 23:24:09.034940 26789 sys_catalog.cc:458] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430 [sys.catalog]: This master's current role is: FOLLOWER
I20260618 23:24:09.034983 26789 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 23:24:09.035017 26789 raft_consensus.cc:686] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430 [term 1 LEADER]: Becoming Leader. State: Replica: cae64a87681348e18c55e05d1660d430, State: Running, Role: LEADER
I20260618 23:24:09.035080 26789 consensus_queue.cc:237] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cae64a87681348e18c55e05d1660d430" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42449 } } peers { permanent_uuid: "10486b8b8f254b13b7184d58b283edbb" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } } peers { permanent_uuid: "533b567389a64507834e17d2ceabd3e5" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } }
I20260618 23:24:09.035477 26789 sys_catalog.cc:455] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cae64a87681348e18c55e05d1660d430. Latest consensus state: current_term: 1 leader_uuid: "cae64a87681348e18c55e05d1660d430" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cae64a87681348e18c55e05d1660d430" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42449 } } peers { permanent_uuid: "10486b8b8f254b13b7184d58b283edbb" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } } peers { permanent_uuid: "533b567389a64507834e17d2ceabd3e5" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } } }
I20260618 23:24:09.035543 26789 sys_catalog.cc:458] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430 [sys.catalog]: This master's current role is: LEADER
I20260618 23:24:09.035727 26537 master_runner.cc:263] No leader master found from master cae64a87681348e18c55e05d1660d430
I20260618 23:24:09.035789 26537 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260618 23:24:09.042840 26808 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260618 23:24:09.043053 26808 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260618 23:24:09.053607 26729 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 533b567389a64507834e17d2ceabd3e5 [term 1 FOLLOWER]: Refusing update from remote peer cae64a87681348e18c55e05d1660d430: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:24:09.053943 26654 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 10486b8b8f254b13b7184d58b283edbb [term 1 FOLLOWER]: Refusing update from remote peer cae64a87681348e18c55e05d1660d430: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 23:24:09.054438 26806 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10486b8b8f254b13b7184d58b283edbb" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:24:09.055097 26806 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "533b567389a64507834e17d2ceabd3e5" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 23:24:09.056329 26775 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10486b8b8f254b13b7184d58b283edbb [sys.catalog]: SysCatalogTable state changed. Reason: New leader cae64a87681348e18c55e05d1660d430. Latest consensus state: current_term: 1 leader_uuid: "cae64a87681348e18c55e05d1660d430" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cae64a87681348e18c55e05d1660d430" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42449 } } peers { permanent_uuid: "10486b8b8f254b13b7184d58b283edbb" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } } peers { permanent_uuid: "533b567389a64507834e17d2ceabd3e5" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } } }
I20260618 23:24:09.056425 26775 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10486b8b8f254b13b7184d58b283edbb [sys.catalog]: This master's current role is: FOLLOWER
I20260618 23:24:09.057466 26761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 533b567389a64507834e17d2ceabd3e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cae64a87681348e18c55e05d1660d430. Latest consensus state: current_term: 1 leader_uuid: "cae64a87681348e18c55e05d1660d430" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cae64a87681348e18c55e05d1660d430" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42449 } } peers { permanent_uuid: "10486b8b8f254b13b7184d58b283edbb" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } } peers { permanent_uuid: "533b567389a64507834e17d2ceabd3e5" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } } }
I20260618 23:24:09.057555 26761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 533b567389a64507834e17d2ceabd3e5 [sys.catalog]: This master's current role is: FOLLOWER
I20260618 23:24:09.060386 26684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:09.036168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50908 (local address 127.3.217.189:43125)
0618 23:24:09.036210 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:09.036212 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:09.037140 (+ 928us) server_negotiation.cc:407] Connection header received
0618 23:24:09.037251 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:09.037252 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:09.037263 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:09.037296 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:09.040152 (+ 2856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:09.040981 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:09.046195 (+ 5214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:09.046543 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:09.046589 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:09.052709 (+ 6120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:09.052710 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:09.052711 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:09.052720 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:09.059090 (+ 6370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:09.059547 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:09.059549 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:09.059549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:09.059605 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:09.059799 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:09.059800 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:09.059800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:09.059931 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:09.060008 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:09.060208 (+ 200us) server_negotiation.cc:299] Negotiation successful
0618 23:24:09.060294 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260618 23:24:09.065563 26558 tablet.cc:2369] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260618 23:24:09.066437 26759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:09.036495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52602 (local address 127.3.217.188:33867)
0618 23:24:09.036531 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:09.036533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:09.038219 (+ 1686us) server_negotiation.cc:407] Connection header received
0618 23:24:09.038317 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:09.038319 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:09.038329 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:09.038382 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:09.042174 (+ 3792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:09.043025 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:09.047471 (+ 4446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:09.047832 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:09.047877 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:09.061365 (+ 13488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:09.061367 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:09.061368 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:09.061376 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:09.063050 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:09.063439 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:09.063440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:09.063440 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:09.063490 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:09.063678 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:09.063679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:09.063679 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:09.063804 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:09.063897 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:09.066270 (+ 2373us) server_negotiation.cc:299] Negotiation successful
0618 23:24:09.066344 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260618 23:24:09.068161 26608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:09.036844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47852 (local address 127.3.217.190:42449)
0618 23:24:09.036892 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:09.036894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:09.039250 (+ 2356us) server_negotiation.cc:407] Connection header received
0618 23:24:09.039352 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:09.039353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:09.039362 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:09.039394 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:09.044233 (+ 4839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:09.045008 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:09.050821 (+ 5813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:09.051150 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:09.051194 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:09.064131 (+ 12937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0618 23:24:09.064133 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0618 23:24:09.064133 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0618 23:24:09.064141 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0618 23:24:09.065767 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:09.067341 (+ 1574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:09.067342 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:09.067343 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:09.067401 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0618 23:24:09.067594 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0618 23:24:09.067595 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0618 23:24:09.067595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0618 23:24:09.067716 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0618 23:24:09.067788 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:09.067981 (+ 193us) server_negotiation.cc:299] Negotiation successful
0618 23:24:09.068059 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260618 23:24:09.070819 26812 mvcc.cc:205] Tried to move back new op lower bound from 7298355400919666688 to 7298355400848506880. Current Snapshot: MvccSnapshot[applied={T|T < 7298355400919666688}]
I20260618 23:24:09.070897 26806 sys_catalog.cc:455] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cae64a87681348e18c55e05d1660d430" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cae64a87681348e18c55e05d1660d430" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42449 } } peers { permanent_uuid: "10486b8b8f254b13b7184d58b283edbb" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } } peers { permanent_uuid: "533b567389a64507834e17d2ceabd3e5" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } } }
I20260618 23:24:09.070989 26806 sys_catalog.cc:458] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430 [sys.catalog]: This master's current role is: LEADER
I20260618 23:24:09.071496 26761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 533b567389a64507834e17d2ceabd3e5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cae64a87681348e18c55e05d1660d430" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cae64a87681348e18c55e05d1660d430" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42449 } } peers { permanent_uuid: "10486b8b8f254b13b7184d58b283edbb" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } } peers { permanent_uuid: "533b567389a64507834e17d2ceabd3e5" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } } }
I20260618 23:24:09.071571 26761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 533b567389a64507834e17d2ceabd3e5 [sys.catalog]: This master's current role is: FOLLOWER
I20260618 23:24:09.071812 26815 mvcc.cc:205] Tried to move back new op lower bound from 7298355400919666688 to 7298355400848506880. Current Snapshot: MvccSnapshot[applied={T|T < 7298355400919666688}]
I20260618 23:24:09.072252 26789 sys_catalog.cc:455] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cae64a87681348e18c55e05d1660d430" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cae64a87681348e18c55e05d1660d430" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42449 } } peers { permanent_uuid: "10486b8b8f254b13b7184d58b283edbb" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } } peers { permanent_uuid: "533b567389a64507834e17d2ceabd3e5" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } } }
I20260618 23:24:09.072327 26789 sys_catalog.cc:458] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430 [sys.catalog]: This master's current role is: LEADER
I20260618 23:24:09.072751 26775 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10486b8b8f254b13b7184d58b283edbb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cae64a87681348e18c55e05d1660d430" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cae64a87681348e18c55e05d1660d430" member_type: VOTER last_known_addr { host: "127.3.217.190" port: 42449 } } peers { permanent_uuid: "10486b8b8f254b13b7184d58b283edbb" member_type: VOTER last_known_addr { host: "127.3.217.189" port: 43125 } } peers { permanent_uuid: "533b567389a64507834e17d2ceabd3e5" member_type: VOTER last_known_addr { host: "127.3.217.188" port: 33867 } } }
I20260618 23:24:09.072831 26775 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10486b8b8f254b13b7184d58b283edbb [sys.catalog]: This master's current role is: FOLLOWER
I20260618 23:24:09.073086 26813 mvcc.cc:205] Tried to move back new op lower bound from 7298355400919666688 to 7298355400848506880. Current Snapshot: MvccSnapshot[applied={T|T < 7298355400919666688}]
I20260618 23:24:09.075098 26808 catalog_manager.cc:1347] Generated new cluster ID: 173819bb39bb4e7da0498af06d4d9379
I20260618 23:24:09.075151 26808 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260618 23:24:09.105748 26808 catalog_manager.cc:1370] Generated new certificate authority record
I20260618 23:24:09.107156 26808 catalog_manager.cc:1504] Loading token signing keys...
I20260618 23:24:09.118851 26808 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cae64a87681348e18c55e05d1660d430: Generated new TSK 0
I20260618 23:24:09.119074 26808 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260618 23:24:09.146778 26608 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:09.145852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47856 (local address 127.3.217.190:42449)
0618 23:24:09.145890 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:09.145893 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:09.146004 (+ 111us) server_negotiation.cc:407] Connection header received
0618 23:24:09.146170 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:09.146171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:09.146182 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:09.146215 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:09.146676 (+ 461us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47856: BlockingRecv error: recv got EOF from 127.0.0.1:47856 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260618 23:24:09.146905 26684 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:09.145845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50920 (local address 127.3.217.189:43125)
0618 23:24:09.145890 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:09.145893 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:09.146355 (+ 462us) server_negotiation.cc:407] Connection header received
0618 23:24:09.146452 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:09.146453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:09.146464 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:09.146494 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:09.146847 (+ 353us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50920: BlockingRecv error: recv got EOF from 127.0.0.1:50920 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260618 23:24:09.147481 26759 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:09.146185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52612 (local address 127.3.217.188:33867)
0618 23:24:09.146229 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:09.146231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:09.147017 (+ 786us) server_negotiation.cc:407] Connection header received
0618 23:24:09.147114 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:09.147114 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:09.147126 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:09.147183 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:09.147427 (+ 244us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52612: BlockingRecv error: recv got EOF from 127.0.0.1:52612 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260618 23:24:09.149143 26684 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:09.148513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50922 (local address 127.3.217.189:43125)
0618 23:24:09.148550 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:09.148552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:09.148706 (+ 154us) server_negotiation.cc:407] Connection header received
0618 23:24:09.148784 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:09.148785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:09.148800 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:09.148840 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:09.149096 (+ 256us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50922: BlockingRecv error: recv got EOF from 127.0.0.1:50922 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260618 23:24:09.151866 26684 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:09.151353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50936 (local address 127.3.217.189:43125)
0618 23:24:09.151389 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:09.151391 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:09.151422 (+ 31us) server_negotiation.cc:407] Connection header received
0618 23:24:09.151493 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:09.151494 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:09.151503 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:09.151546 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:09.151820 (+ 274us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50936: BlockingRecv error: recv got EOF from 127.0.0.1:50936 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260618 23:24:09.155620 26684 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:09.155015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50950 (local address 127.3.217.189:43125)
0618 23:24:09.155053 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:09.155055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:09.155173 (+ 118us) server_negotiation.cc:407] Connection header received
0618 23:24:09.155238 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:09.155240 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:09.155249 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:09.155304 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:09.155570 (+ 266us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50950: BlockingRecv error: recv got EOF from 127.0.0.1:50950 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260618 23:24:09.161129 26684 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:09.160471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50960 (local address 127.3.217.189:43125)
0618 23:24:09.160507 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:09.160509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:09.160636 (+ 127us) server_negotiation.cc:407] Connection header received
0618 23:24:09.160732 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:09.160733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:09.160743 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:09.160815 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:09.161075 (+ 260us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50960: BlockingRecv error: recv got EOF from 127.0.0.1:50960 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260618 23:24:09.171288 26684 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:09.170205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50976 (local address 127.3.217.189:43125)
0618 23:24:09.170252 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:09.170254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:09.170401 (+ 147us) server_negotiation.cc:407] Connection header received
0618 23:24:09.170478 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:09.170479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:09.170492 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:09.170552 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:09.171207 (+ 655us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50976: BlockingRecv error: recv got EOF from 127.0.0.1:50976 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260618 23:24:09.188726 26684 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:09.187970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50990 (local address 127.3.217.189:43125)
0618 23:24:09.188016 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:09.188018 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:09.188147 (+ 129us) server_negotiation.cc:407] Connection header received
0618 23:24:09.188250 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:09.188251 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:09.188263 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:09.188344 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:09.188658 (+ 314us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50990: BlockingRecv error: recv got EOF from 127.0.0.1:50990 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260618 23:24:09.222569 26684 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:09.221963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50996 (local address 127.3.217.189:43125)
0618 23:24:09.222039 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:09.222041 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:09.222050 (+ 9us) server_negotiation.cc:407] Connection header received
0618 23:24:09.222079 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:09.222080 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:09.222092 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:09.222160 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:09.222484 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50996: BlockingRecv error: recv got EOF from 127.0.0.1:50996 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260618 23:24:09.288870 26684 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:09.287961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51002 (local address 127.3.217.189:43125)
0618 23:24:09.288059 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:09.288061 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:09.288078 (+ 17us) server_negotiation.cc:407] Connection header received
0618 23:24:09.288189 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:09.288190 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:09.288203 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:09.288308 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:09.288788 (+ 480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51002: BlockingRecv error: recv got EOF from 127.0.0.1:51002 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260618 23:24:09.418807 26684 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:09.418145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51010 (local address 127.3.217.189:43125)
0618 23:24:09.418229 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:09.418231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:09.418241 (+ 10us) server_negotiation.cc:407] Connection header received
0618 23:24:09.418270 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:09.418271 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:09.418289 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:09.418355 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:09.418695 (+ 340us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51010: BlockingRecv error: recv got EOF from 127.0.0.1:51010 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260618 23:24:09.677017 26684 negotiation.cc:337] Failed RPC negotiation. Trace:
0618 23:24:09.676314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51018 (local address 127.3.217.189:43125)
0618 23:24:09.676406 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:09.676409 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:09.676425 (+ 16us) server_negotiation.cc:407] Connection header received
0618 23:24:09.676513 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:09.676514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:09.676525 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:09.676593 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0618 23:24:09.676960 (+ 367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51018: BlockingRecv error: recv got EOF from 127.0.0.1:51018 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260618 23:24:09.963636 26772 catalog_manager.cc:1259] Loaded cluster ID: 173819bb39bb4e7da0498af06d4d9379
I20260618 23:24:09.963716 26772 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 533b567389a64507834e17d2ceabd3e5: loading cluster ID for follower catalog manager: success
I20260618 23:24:09.964494 26772 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 533b567389a64507834e17d2ceabd3e5: acquiring CA information for follower catalog manager: success
I20260618 23:24:09.964746 26772 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 533b567389a64507834e17d2ceabd3e5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260618 23:24:09.995148 26786 catalog_manager.cc:1259] Loaded cluster ID: 173819bb39bb4e7da0498af06d4d9379
I20260618 23:24:09.995252 26786 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 10486b8b8f254b13b7184d58b283edbb: loading cluster ID for follower catalog manager: success
I20260618 23:24:09.996037 26786 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 10486b8b8f254b13b7184d58b283edbb: acquiring CA information for follower catalog manager: success
I20260618 23:24:09.996325 26786 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 10486b8b8f254b13b7184d58b283edbb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260618 23:24:10.194331 26885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:10.190494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51030 (local address 127.3.217.189:43125)
0618 23:24:10.190613 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:10.190616 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:10.190690 (+ 74us) server_negotiation.cc:407] Connection header received
0618 23:24:10.190833 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:10.190834 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:10.190920 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:10.191031 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:24:10.191221 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:10.192060 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:10.193189 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:10.193514 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:10.193625 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:10.193858 (+ 233us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:24:10.194030 (+ 172us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:24:10.194104 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:10.194153 (+ 49us) server_negotiation.cc:299] Negotiation successful
0618 23:24:10.194233 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":68,"threads_started":1}
I20260618 23:24:10.198902 26891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:10.196283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52628 (local address 127.3.217.188:33867)
0618 23:24:10.196408 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:10.196410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:10.196418 (+ 8us) server_negotiation.cc:407] Connection header received
0618 23:24:10.196451 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:10.196451 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:10.196483 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:10.196552 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:24:10.196622 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:10.197096 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:10.197852 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:10.198049 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:10.198111 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:10.198306 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:24:10.198427 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:24:10.198499 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:10.198705 (+ 206us) server_negotiation.cc:299] Negotiation successful
0618 23:24:10.198800 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":66,"threads_started":1}
I20260618 23:24:10.203740 26897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:10.200609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47868 (local address 127.3.217.190:42449)
0618 23:24:10.200777 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:10.200779 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:10.200910 (+ 131us) server_negotiation.cc:407] Connection header received
0618 23:24:10.201045 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:10.201046 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:10.201095 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:10.201170 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:24:10.201368 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:10.202086 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:10.202843 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:10.203133 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:10.203199 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:10.203373 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:24:10.203468 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:24:10.203525 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:10.203606 (+ 81us) server_negotiation.cc:299] Negotiation successful
0618 23:24:10.203632 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":98,"threads_started":1}
I20260618 23:24:10.203802 26885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:10.200555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51034 (local address 127.3.217.189:43125)
0618 23:24:10.200595 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:10.200597 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:10.200827 (+ 230us) server_negotiation.cc:407] Connection header received
0618 23:24:10.200932 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:10.200933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:10.200946 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:10.200975 (+ 29us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:24:10.201173 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:10.201924 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:10.203053 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:10.203343 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:10.203421 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:10.203543 (+ 122us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:24:10.203572 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:24:10.203616 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:10.203708 (+ 92us) server_negotiation.cc:299] Negotiation successful
0618 23:24:10.203727 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260618 23:24:10.204885 26891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0618 23:24:10.200901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52636 (local address 127.3.217.188:33867)
0618 23:24:10.200938 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0618 23:24:10.200940 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0618 23:24:10.201041 (+ 101us) server_negotiation.cc:407] Connection header received
0618 23:24:10.201097 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0618 23:24:10.201098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0618 23:24:10.201110 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0618 23:24:10.201178 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0618 23:24:10.202163 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:10.202908 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:10.203938 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0618 23:24:10.204246 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0618 23:24:10.204287 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0618 23:24:10.204636 (+ 349us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0618 23:24:10.204661 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0618 23:24:10.204699 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0618 23:24:10.204781 (+ 82us) server_negotiation.cc:299] Negotiation successful
0618 23:24:10.204806 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260618 23:24:10.205798 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 26537
I20260618 23:24:10.211002 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 26612
I20260618 23:24:10.216364 3942 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskY_cj0P/build/release/bin/kudu with pid 26687
2026-06-18T23:24:10Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2993 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5939 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (280939 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST